How to get rid of bad bots crawling my site

[Neo]

There are some bots that crawl the sites for useless purposes for us. The biggest problem is they eat bandwidth.
To get rid of them, you can simply configure your .htaccess file as follows.

Code: Select all

SetEnvIfNoCase User-Agent ^Java/1. javabot=yes
SetEnvIfNoCase User-Agent ^Java1. javabot=yes
Deny from env=javabot

Those will get a 403 error and that's the end of it.