|Posted: 14 October 2011 at 8:41am
I usually redirect bad bots to a dead page using the following code:
RewriteCond User-Agent: (?:Xenu).*
RewriteRule .* /999.html [L]
However it isn't working with one particularly bad bod (80legs), which has brought our server down and at times is requested dozens of pages a second from numerous IP addresses around the world.
The user agent line is:
Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html;) Gecko/2008032620
I've tried these and neither of them work:
RewriteCond User-Agent: (?:008).*
RewriteCond User-Agent: (?:008/0.83).*
Any ideas on how to redirect this troublemaker gratefully received.