google bots

bohemianutopist
bohemianutopist Posts: 123
edited October 2005 in Technical Stuff and Help
why does this board allow google bots? i posted the link to a picture of mine here and because the board allows google bots, it's now on google. i've deleted the photo from my server but it still shows up on google because this board still lists its URL. argh! can't you guys create a robots.txt file that blocks jpgs and gifs?
this board is too crazy for me these days...
Post edited by Unknown User on

Comments

  • JaneNY
    JaneNY Posts: 4,438
    would you explain a little more about what google bots are?
    R.i.p. Rigoberto Alpizar.
    R.i.p. My Dad - May 28, 2007
    R.i.p. Black Tail (cat) - Sept. 20, 2008
  • justjoshingu
    justjoshingu Posts: 538
    all your base belong to us
    mean people suck!
    but nice people sw****w

  • aNiMaL
    aNiMaL Posts: 7,117
    Google Spiders happen whether you want them to or not. If you click here: http://forums.pearljam.com/online.php? and scroll towards the end where all the Guest hits are....you will see Google Spiders. They crawl the web to catalog it and cache it for their searches. You do understand that this is a public forum, right? If you don't want things to be on the world wide web, then you shouldn't post things to the world wide web.
  • Duff_Man
    Duff_Man Posts: 150
    if you want to stop the googlebots and any others, if you add this code (in the header) to the index (or home page) it should help:

    <META NAME="ROBOTS" CONTENT="NOINDEX","NOFOLLOW">


    but im not sure that this board will support it

    and i dont think that any of the admin will bother as its not causing harm
    We did not change as we grew older; we just became more clearly ourselves.
  • bohemianutopist
    bohemianutopist Posts: 123
    aNiMaL wrote:
    Google Spiders happen whether you want them to or not. If you click here: http://forums.pearljam.com/online.php? and scroll towards the end where all the Guest hits are....you will see Google Spiders. They crawl the web to catalog it and cache it for their searches. You do understand that this is a public forum, right? If you don't want things to be on the world wide web, then you shouldn't post things to the world wide web.

    google bots and all other spiders can be stopped.

    also, i don't really mind the photo being up there. i was more annoyed with the fact that it was eating up my bandwidth than i was with people being able to see it.
    this board is too crazy for me these days...
  • bohemianutopist
    bohemianutopist Posts: 123
    Duff_Man wrote:
    if you want to stop the googlebots and any others, if you add this code (in the header) to the index (or home page) it should help:

    <META NAME="ROBOTS" CONTENT="NOINDEX","NOFOLLOW">


    but im not sure that this board will support it

    and i dont think that any of the admin will bother as its not causing harm

    i know that. the reason i posted here is because i have no control over the index page of this board. all the pages i own are protected from spiders.
    this board is too crazy for me these days...
  • JaneNY
    JaneNY Posts: 4,438
    justjoshingu wrote:
    all your base belong to us

    god, that thing is ANCIENT, i mean like 5 years

    thanks others for more info
    R.i.p. Rigoberto Alpizar.
    R.i.p. My Dad - May 28, 2007
    R.i.p. Black Tail (cat) - Sept. 20, 2008
  • Thecrownofthorns
    Thecrownofthorns Posts: 319
    http://en.wikipedia.org/wiki/All_your_base_are_belong_to_us

Categories