楼上(shàng )说的很多,我补(bǔ )充(chōng )一(yī )下,正(zhèng )确的应该叫网(wǎng )络(luò )蜘蛛,又称(chēng )爬虫,本质是搜索(suǒ )引(yǐn )擎派出的(de )一个执行抓(zhuā )取任务的程序(xù )蜘蛛池的本(běn )质是大(dà )量的网(wǎng )站(zhàn )互相链接,每个站单(dān )独产生(shēng )大量的内容(róng )吸(xī )引蜘蛛来(lái )爬(pá ),几(jǐ )千个(gè )网站(zhàn )互(hù )链时(shí ),可(kě )以想象蜘蛛的链接(jiē )
Copyright © 2008-2018