Switch to English Language Passer en langue française Omschakelen naar Nederlandse Taal Wechseln Sie zu deutschen Sprache Passa alla lingua italiana
Members: 69,879   Posts: 1,520,374   Online: 1105
      
Page 1 of 2 12 LastLast
Results 1 to 10 of 17
  1. #1
    Sean's Avatar
    Join Date
    Aug 2002
    Location
    New Zealand
    Shooter
    Multi Format
    Posts
    8,547
    Blog Entries
    7
    Images
    15

    Bit of grief with site stability today..

    Hi guys, for some reason the application blocking all of the search and spam bots quit working (leaving us vulnerable to bot attacks again). I have raised a call with that company for help and am just waiting to hear back. In the meantime it is a game of cat and mouse to manually ban the bots giving us trouble until I can get the app back up. I may have caught the few giving us issues today, if not we'll have to go offline again. Thanks, Sean

  2. #2
    Kevin Caulfield's Avatar
    Join Date
    Aug 2004
    Location
    Melbourne, Australia
    Shooter
    Multi Format
    Posts
    3,093
    Blog Entries
    5
    Images
    52
    Thanks, Sean, for getting it up again, and also for providing the temporary chat room for we desperadoes.

  3. #3
    Sean's Avatar
    Join Date
    Aug 2002
    Location
    New Zealand
    Shooter
    Multi Format
    Posts
    8,547
    Blog Entries
    7
    Images
    15
    *update*

    I haven't gotten the bot blocking application back on yet, but I did do a few things that seem to have us stable (cleaned up some code, removed old unused tables from our database, and ran a full repair against all tables in the database). So far it's been over an hour without an issue. I have re-opened the gallery as well. Thanks

  4. #4

    Join Date
    Sep 2002
    Location
    State College, PA
    Shooter
    ULarge Format
    Posts
    336
    Sean,

    Thanks for the effort...

    I was wondering, would it be possible to eliminate the bots by making everyone go through a hompeage where the access is granted through an encoded password like those used when people are registering an ID on some places (you know, the code is a graphic with fuzzy lines and other junk so a computer can't automatically read the file)?

    Then, you change the access on a semi-random pattern, with semi-random codes. Once you enter the code, it updates your cookie, giving you access to the entirety of the site. The next time you try to enter, the code won't be up to date, and you'll have to manually enter a new code. If the code changes while someone is browsing, it'll pop up the access page when they try to load a new page after the code change. Manually enter the new code, and you're on your way.

    I'm not a programmer, so tell me how stupid of an idea that is.


    ---Michael
    www.mutmansky.com
    B&W photography in Silver, Palladium, and gum bichromate.

  5. #5
    Sean's Avatar
    Join Date
    Aug 2002
    Location
    New Zealand
    Shooter
    Multi Format
    Posts
    8,547
    Blog Entries
    7
    Images
    15
    Well, that would probably work, but it would then block the site to all visitors and guests. It would be quite easy to totally lock the forum and gallery so that only registered users can access them, the big drawback though is denying visitor access. My long term plan is to get all bots under control, then open us to a few specific bots every now and then (yahoo, google) just to keep our indexes on the net. The net is turning into a warzone though, so I would not be surprised if many sites start opting for a registration only access model to keep all the bots and spammers off their sites..

  6. #6
    Baxter Bradford's Avatar
    Join Date
    Nov 2004
    Location
    Lymington, South Coast, UK
    Shooter
    4x5 Format
    Posts
    772
    Images
    102
    Are you sure that the threat was purely external?

    It might be that the site itself was expressing its distress about all of the opinionary fisticuffs and fireworks that were happening over in "Ethics and Philosophy". I'm surprised Sean that you weren't contacted by Don King to try to get that thread (where academic brilliance threatened to overtake the thread subject matter) as pay per view..........

  7. #7
    Digidurst's Avatar
    Join Date
    Feb 2005
    Location
    SC
    Shooter
    Multi Format
    Posts
    629
    Images
    10
    Hi Sean You probably already know this but just in case, I'm not getting anything when I click on the links for either 'Chemistry Recipes' or 'Articles'.

    Thanks for working so hard to get the site back up! Take care and cheers!

  8. #8
    Sean's Avatar
    Join Date
    Aug 2002
    Location
    New Zealand
    Shooter
    Multi Format
    Posts
    8,547
    Blog Entries
    7
    Images
    15
    Quote Originally Posted by Digidurst
    Hi Sean You probably already know this but just in case, I'm not getting anything when I click on the links for either 'Chemistry Recipes' or 'Articles'.

    Thanks for working so hard to get the site back up! Take care and cheers!
    Thanks for the heads up, it's fixed now

  9. #9
    Ed Sukach's Avatar
    Join Date
    Nov 2002
    Location
    Ipswich, Massachusetts, USA
    Shooter
    Medium Format
    Posts
    4,520
    Images
    26
    Quote Originally Posted by Baxter Bradford
    Are you sure that the threat was purely external?

    It might be that the site itself was expressing its distress about all of the opinionary fisticuffs and fireworks that were happening over in "Ethics and Philosophy". I'm surprised Sean that you weren't contacted by Don King to try to get that thread (where academic brilliance threatened to overtake the thread subject matter) as pay per view..........
    Ah, yes. There is a LOT of "Making waves" over there. Consider, though; the waves are what keeps the water clear. Without them --- well ... think of a swamp.

    I had just completed a brilliant, and involved, post when .... "Pardon the Inconvenience While ...", came up on the screen. Not a "bad" thing though - gave me - FORCED me - to reflect on what I was writing, and being concise.
    Carpe erratum!!

    Ed Sukach, FFP.

  10. #10
    Will S's Avatar
    Join Date
    Nov 2004
    Location
    Madison, Wisconsin
    Shooter
    Multi Format
    Posts
    698
    Images
    34
    Quote Originally Posted by Sean
    Hi guys, for some reason the application blocking all of the search and spam bots quit working (leaving us vulnerable to bot attacks again). I have raised a call with that company for help and am just waiting to hear back. In the meantime it is a game of cat and mouse to manually ban the bots giving us trouble until I can get the app back up. I may have caught the few giving us issues today, if not we'll have to go offline again. Thanks, Sean
    I thought that robots.txt just worked all on its lonesome and that the bot read it and processed accordingly. These must be bots that aren't adhering to the standard? Or did someone remove your files?

    Good luck with that. I once ran a site in the early 90s that kicked off large database queries in a lot of the links. We got brought down by Google for about a week. And this was before we had any means of telling the spider to stop! We had to call Google and ask them to quit it, and they wouldn't kill their jobs once they had started, etc., etc. Thankfully the robots.txt method showed up shortly thereafter (this was in 1994).

    Best,

    Will
    "I am an anarchist." - HCB
    "I wanna be anarchist." - JR

Page 1 of 2 12 LastLast


 

APUG PARTNERS EQUALLY FUNDING OUR COMMUNITY:



Contact Us  |  Support Us!  |  Advertise  |  Site Terms  |  Archive  —   Search  |  Mobile Device Access  |  RSS  |  Facebook  |  Linkedin