楼上说的(de )很(hěn )多,我补充一(yī )下,正确的应(yīng )该(gāi )叫网(wǎng )络蜘蛛,又称爬虫,本质是(shì )搜索引擎(qíng )派出(chū )的一(yī )个执行(háng )抓取任务的程序(xù )蜘蛛(zhū )池的本质是(shì )大(dà )量的(de )网站(zhàn )互相链接(jiē ),每(měi )个站单独(dú )产生大(dà )量的内容吸引蜘蛛来(lái )爬(pá ),几千个网站(zhàn )互链时(shí ),可(kě )以想象蜘(zhī )蛛(zhū )的链接(jiē )
Copyright © 2008-2018