Sogou的蜘蛛怎么这么疯狂？堪比DDoS了

V2EX = way to explore

V2EX 是一个关于分享和探索的地方

现在注册

已注册用户请登录

推荐书目

› 高性能网站建设进阶指南

› High Performance Web Sites

› Google Hacks: Tips & Tools for Finding and Using the World's Information

关于 Google SEO 最好的一本书

这是一个创建于 3982 天前的主题，其中的信息可能已经有所发展或是发生改变。

66.249.64.1 - - [24/Dec/2013:23:10:56 +0800] bbs.quxizang.net "GET /redirect.php?goto=findpost&pid=567887 HTTP/1.0" 302 20 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
218.30.103.97 - - [24/Dec/2013:23:10:56 +0800] bbs.quxizang.net "GET /topic/144666.html HTTP/1.0" 403 4571 "-" "Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)"
220.181.89.164 - - [24/Dec/2013:23:10:56 +0800] bbs.quxizang.net "GET /topic/6636/last/ HTTP/1.0" 403 4571 "-" "Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)"
218.30.103.87 - - [24/Dec/2013:23:10:57 +0800] bbs.quxizang.net "GET /member/154806.html HTTP/1.0" 403 4571 "-" "Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)"
61.135.189.124 - - [24/Dec/2013:23:10:57 +0800] bbs.quxizang.net "GET /topic/167728.html HTTP/1.0" 403 4571 "-" "Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)"
218.30.103.157 - - [24/Dec/2013:23:10:57 +0800] bbs.quxizang.net "GET /topic/140326/p2.html HTTP/1.0" 403 4571 "-" "Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)"
218.30.103.148 - - [24/Dec/2013:23:10:57 +0800] bbs.quxizang.net "GET /topic/29477.html HTTP/1.0" 403 4571 "-" "Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)"
66.249.64.2 - - [24/Dec/2013:23:10:57 +0800] bbs.quxizang.net "GET /topic/178887.html HTTP/1.0" 200 7465 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
218.30.103.132 - - [24/Dec/2013:23:10:57 +0800] bbs.quxizang.net "GET /topic/22570.html HTTP/1.0" 403 4571 "-" "Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)"
66.249.64.4 - - [24/Dec/2013:23:10:57 +0800] m.quxizang.net "GET /bbs/t7730.html HTTP/1.0" 200 2151 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
218.30.103.154 - - [24/Dec/2013:23:10:58 +0800] bbs.quxizang.net "GET /topic/119864.html HTTP/1.0" 403 4571 "-" "Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)"
61.135.189.70 - - [24/Dec/2013:23:10:58 +0800] bbs.quxizang.net "GET /topic/112342.html HTTP/1.0" 403 4571 "-" "Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)"
218.30.103.152 - - [24/Dec/2013:23:10:58 +0800] bbs.quxizang.net "GET /topic/29939/ HTTP/1.0" 403 4571 "-" "Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)"

quxizang

NET

bbs

7 条回复 • 1970-01-01 08:00:00 +08:00