4 ms·
As for open-source crawler goes, I've heard of SpiderLing (http://corpus.tools/wiki/SpiderLing http://corpus.tools/wiki/SpiderLing) which is somewhat specialize
by titanix2 9y ago
As for open-source crawler goes, I've heard of SpiderLing (http://corpus.tools/wiki/SpiderLing http://corpus.tools/wiki/SpiderLing) which is somewhat specialized for building text corpus.