3 ms·
If you really want to scrape pages, you should use something like https://github.com/chriso/node.io/ https://github.com/chriso/node.io/ which batches things in
by latchkey 14y ago
If you really want to scrape pages, you should use something like https://github.com/chriso/node.io/ https://github.com/chriso/node.io/ which batches things in jobs, helps with error handling, io, etc...