Switch to English Language Passer en langue française Omschakelen naar Nederlandse Taal Wechseln Sie zu deutschen Sprache Passa alla lingua italiana
Members: 71,822   Posts: 1,581,928   Online: 988
      
Page 2 of 2 FirstFirst 12
Results 11 to 17 of 17
  1. #11
    Sean's Avatar
    Join Date
    Aug 2002
    Location
    New Zealand
    Shooter
    Multi Format
    Posts
    8,591
    Blog Entries
    7
    Images
    15
    Hi Will, yeah robots.txt seems quite useless these days..

  2. #12
    Sean's Avatar
    Join Date
    Aug 2002
    Location
    New Zealand
    Shooter
    Multi Format
    Posts
    8,591
    Blog Entries
    7
    Images
    15
    *UPDATE*

    Hello all, rather than leave the site down, I have made it so registered users have access. This means searchbots & spambots which are categorized as "guests" will not be able to attach to us... which means we should be ok. I'll keep an eye on things. Unfortunately the day job is calling so hopefully this will keep us going until I can resolve the other issues. Thanks

  3. #13
    Sean's Avatar
    Join Date
    Aug 2002
    Location
    New Zealand
    Shooter
    Multi Format
    Posts
    8,591
    Blog Entries
    7
    Images
    15

    Might be ok now

    The robot blocking application is back in action, and I'm shocked to see it has blocked about 75 Inktomi Slurp spiders from our forums! This is a Yahoo spider system. I like us being indexed on the internet but these search sites like Yahoo, google, msn, need to learn how to control their systems! Anyway, things look ok right now, time will tell. Thanks

  4. #14
    titrisol's Avatar
    Join Date
    Aug 2004
    Location
    Rotterdam
    Shooter
    Multi Format
    Posts
    1,671
    Images
    8
    Can the RSS feed have something to do with it?
    I added apug to My Yahoo! for one

    Quote Originally Posted by Sean
    The robot blocking application is back in action, and I'm shocked to see it has blocked about 75 Inktomi Slurp spiders from our forums! This is a Yahoo spider system. I like us being indexed on the internet but these search sites like Yahoo, google, msn, need to learn how to control their systems! Anyway, things look ok right now, time will tell. Thanks
    Mama took my APX away.....

  5. #15
    Sean's Avatar
    Join Date
    Aug 2002
    Location
    New Zealand
    Shooter
    Multi Format
    Posts
    8,591
    Blog Entries
    7
    Images
    15
    Nope, it's definitely search spiders. There are still some issues to work through so no guarantees we are 100% up. The robot control application is running in a limitted way until I can get hold of their support again..

  6. #16
    Sean's Avatar
    Join Date
    Aug 2002
    Location
    New Zealand
    Shooter
    Multi Format
    Posts
    8,591
    Blog Entries
    7
    Images
    15
    *update..

    I hate to say all is well.. again but i did make progress in getting the spider blocking app fully functional. I noticed all the Inktomi Slurp spider listings showing in our guests list have dropped off. We'll see how it goes.

  7. #17
    Flotsam's Avatar
    Join Date
    Sep 2002
    Location
    S.E. New York State
    Posts
    3,221
    Images
    13
    Did you really change servers again?
    That is called grain. It is supposed to be there.
    =Neal W.=

Page 2 of 2 FirstFirst 12


 

APUG PARTNERS EQUALLY FUNDING OUR COMMUNITY:



Contact Us  |  Support Us!  |  Advertise  |  Site Terms  |  Archive  —   Search  |  Mobile Device Access  |  RSS  |  Facebook  |  Linkedin