# slow down all crawlers User-agent: * Crawl-delay: 10 # Baidu (CN) http://help.baidu.com/question?prod_en=master&class=498&id=1000973 User-agent: Baiduspider Disallow: / # Haosou (CN) http://www.haosou.com/help/help_3_2.html User-agent: 360Spider User-agent: HaoSouSpider Disallow: / # Yandex (RU) Info: http://yandex.com/bots User-agent: Yandex Disallow: / # SoGou (CN) http://www.sogou.com/docs/help/webmasters.htm#07 User-agent: sogou spider Disallow: / # Goo (JP) http://help.goo.ne.jp/help/article/853/ User-agent: moget User-agent: ichiro Disallow: / # Rediff (IN) www.rediff.com User-agent: RedBot Disallow: / # Naver (KR) http://help.naver.com/customer/etc/webDocument02.nhn User-agent: NaverBot User-agent: Yeti Disallow: / # Youdao (CN) http://www.youdao.com/help/webmaster/spider/ User-agent: YoudaoBot Disallow: /