3 ms·
I found https://github.com/cgiffard/node-simplecrawler https://github.com/cgiffard/node-simplecrawler to be good, I used it for https://github.com/tmpfs/linkdow
by tmpfs 10y ago
I found https://github.com/cgiffard/node-simplecrawler https://github.com/cgiffard/node-simplecrawler to be good, I used it for https://github.com/tmpfs/linkdown https://github.com/tmpfs/linkdown - a cli for validating web pages etc.