百度
User-agent:Baiduspider+(+http://www.baidu.com/search/spider.htm)
google
User-agent:Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
google adwords
User-agent:Adsbot-Google
google图片
User-agent:Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html) Google image crawler
Bing
User-agent:msnbot/1.0 (+http://search.msn.com/msnbot.htm)
youdao
User-agent:Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )
yahoo中国
User-agent:Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)
sougou
User-agent:Sogou Orion spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
soso
User-agent:Sosospider+(+http://help.soso.com/webspider.htm)
soso图片
User-agent:Sosoimagespider+(+http://help.soso.com/soso-image-spider.htm)
2 Comments.