User-agent A-Online Search
User-agent ZyBorg/1.0
User-agent ATN_Worldwide
User-agent Arachnophilia
User-agent ArchitextSpider
User-agent FAST
User-agent Crawler V 0.2.1 admin@crawler.de
User-agent CoolBot
User-agent Deweb1.01
User-agent grabber
User-agent Eule-Robot
User-agent Arachnoidea
User-agent IBM_Planetwide
User-agent InfoSeek Sidewinder0.9
User-agent Slurp
User-agent LinkWalker
User-agent Tarantula
User-agent Gulliver1.3
User-agent fido1.0 Harvest1.4.pl2
User-agent MegaSheep
User-agent Ultraseek
User-agent whatUseek_winona
User-agent Yahoo! Slurp
Disallow cgi-bin
Disallow index.html
Disallow index.php
Disallow forum