# ASM Consortium robots.txt

User-agent: Baiduspider+(+http://www.baidu.com/search/spider.htm)
Disallow: /

User-agent: Baiduspider+(+http://www.baidu.com/search/spider_jp.html)
Disallow: /

User-agent: Enabot/1.2 (http://www.enaball.com/crawler.html)
Disallow: /

User-agent: FAST MetaWeb Crawler (helpdesk at fastsearch dot.com)
Disallow: /

User-agent: holmes/3.12 (OnetSzukaj/5.0; +http://szukaj.onet.pl)
Disallow: /

User-agent: ia_archiver
Disallow: /

User-agent: IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler)
Disallow: /

User-agent: larbin_2.6.3 (larbin2.6.3@unspecified.mail)
Disallow: /

User-agent: Lycos_Spider_(modspider)
Disallow: /

User-agent: MJ12bot/v1.2.0 (http://majestic12.co.uk/bot.php+)
Disallow: /

User-agent: panscient.com
Disallow: /

User-agent: sogou spider
Disallow: /

User-agent: sogou web spider
Disallow: /

User-agent: TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html)
Disallow: /

User-agent: WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU)
Disallow: /

User-agent: WebReaper[support@webreaper.net]
Disallow: /

User-agent: WebReaper v10.0 - www.webreaper.net
Disallow: /