楼(lóu )上(shàng )说(shuō )的(de )很多,我补(bǔ )充一下,正确的应该叫网(wǎng )络蜘蛛,又(yòu )称(chēng )爬虫(chóng ),本质(zhì )是(shì )搜索引(yǐn )擎(qíng )派出的一(yī )个(gè )执行(háng )抓取任务的程序蜘蛛池的本质是大(dà )量的网站互相链(liàn )接,每个站单(dān )独产(chǎn )生(shēng )大(dà )量(liàng )的内容吸引蜘蛛(zhū )来(lái )爬(pá ),几千(qiān )个网站互链时(shí ),可以想象蜘蛛的链接(jiē )
Copyright © 2008-2018