As promised, we’re proud to announce our first release.
Antidouche Lite for Bad Bots: download .zip.
This is a very small bit of php code that checks against a very basic list of known bad bots’ user agents which are typically scrappers or other crappy bots that are no use to you, eat up bandwidth and thus might be denying your users/readers/google a quick response.
Future updates will include additions to the list as they come available (feel free to just download the list to your own server too if you want). Additionally, we’re looking at a seperate whitelist list as well as adding other good bots (non google/yahoo/MSN) which you may want to block anyway.
This code has been tested against a site with ~800,000 pageviews/day for low overhead.
Give it a spin before you bother downloading! From your terminal wget –user-agent autoemailspider osdir.com/ml/php.cvs.zend/2008-01/msg00016.html
