楼(lóu )上说的很多,我(wǒ )补(bǔ )充(chōng )一下,正确的应(yīng )该叫网(wǎng )络蜘蛛,又(yòu )称爬(pá )虫,本质是(shì )搜索引(yǐn )擎派出(chū )的一个(gè )执(zhí )行抓(zhuā )取任务的程序(xù )蜘蛛(zhū )池的本质(zhì )是大量(liàng )的网站互(hù )相链(liàn )接(jiē ),每个站(zhàn )单独产生(shēng )大(dà )量的内容吸引蜘蛛来爬,几千个网(wǎng )站互(hù )链时,可以想(xiǎng )象蜘(zhī )蛛(zhū )的链接(jiē )
Copyright © 2008-2018