5 ms·
nice! I did a webcrawler with node.js myself last year. It's only a quick try but you can find the worker class here: https://gist.github.com/zerni/6337067 htt
by zerni 13y ago
nice!
I did a webcrawler with node.js myself last year. It's only a quick try but you can find the worker class here: https://gist.github.com/zerni/6337067 https://gist.github.com/zerni/6337067
Unfortunately jsdom had a memory leak so the crawler died after a while...