How to get rid of bad bots crawling my site
Posted: Sat Apr 03, 2010 8:07 pm
There are some bots that crawl the sites for useless purposes for us. The biggest problem is they eat bandwidth.
To get rid of them, you can simply configure your .htaccess file as follows.
Those will get a 403 error and that's the end of it.
To get rid of them, you can simply configure your .htaccess file as follows.
Code: Select all
SetEnvIfNoCase User-Agent ^Java/1. javabot=yes
SetEnvIfNoCase User-Agent ^Java1. javabot=yes
Deny from env=javabot