Hmm, on further inspection I noticed this does away with bad spiders too . . . been looking for just such a thing. I’ve got a couple over very persistant spiders that just hammer my server . . . regardless of what the robots.txt file instructs . . . I’ll let you know how it works.
“No drug, not even alcohol, causes the fundamental ills of society. If we're looking for the source of our troubles, we shouldn't test people for drugs, we should test them for stupidity, ignorance, greed and love of power.” byP.J. Oâ..Rourke
September 12th, 2005 at 3:42 pm
What do you mean you don’t like spam?
Glad to hear it’s working well.
September 12th, 2005 at 9:52 pm
Hmm, on further inspection I noticed this does away with bad spiders too . . . been looking for just such a thing.
I’ve got a couple over very persistant spiders that just hammer my server . . . regardless of what the robots.txt file instructs . . . I’ll let you know how it works.