#http://translate.google.com/translate?js=y&prev=_t&hl=en&ie=UTF-8&u=http://www.baidu.com/search/spider.htm&sl=auto&tl=en User-agent: baiduspider Disallow: #http://www.google.com/bot.html User-agent: googlebot Disallow: #http://search.msn.com/msnbot.htm User-agent: msnbot Disallow: #http://help.yahoo.com/help/us/ysearch/slurp - lots of load, no referrals #User-agent: yahoo-slurp #http://translate.google.com/translate?js=y&prev=_t&hl=en&ie=UTF-8&u=http://www.sogou.com/docs/help/webmasters.htm&sl=auto&tl=en #User-agent: Sogou web spider #If you're not baidu, google, or bing, don't bother me. I'm not big enough for you to care about. User-agent: * Disallow: / # BEGIN XML-SITEMAP-PLUGIN Sitemap: http://words.timsworlds.com/sitemap.xml.gz # END XML-SITEMAP-PLUGIN