🍪
Cookies help us deliver our services. By using our services, you agree to our use of cookies.

Htaccess Deny

Note that malware or email harvesting bots will ignore the directives of the robots.txt file, you must create an entry in your .htaccess file.

The following example was provided by Gustave Dahl on User2 list 11/12/2009 11:05 PM


BrowserMatchNoCase PiplBot bad_bot
BrowserMatchNoCase MJ12bod bad_bot
Order Deny, Allow
Deny from env=bad_bot

ICDSoft support also provided the following as a another way to ban bots


SetEnvIfNoCase User-Agent "Yahoo" badBot
SetEnvIfNoCase User-Agent "bingbot" badBot
SetEnvIfNoCase User-Agent "MJ12bot" badBot
SetEnvIfNoCase User-Agent "Yandex" badBot
SetEnvIfNoCase User-Agent "BaiDuSpider" badBot
SetEnvIfNoCase User-Agent "Mail.ru" badBot
Deny from env=badBot


References

Related links

The following provide additional security measures:

Controlling Site Access

Protecting Resources

Checking your site for Malware