3 ms·
Headless Chrome, Puppeteer, NodeJS (jsdom), and MongoDB. Fantastic stack for web data mining. Async based using promises for explicit user input flow automation
by indescions_2017 9y ago
Headless Chrome, Puppeteer, NodeJS (jsdom), and MongoDB. Fantastic stack for web data mining. Async based using promises for explicit user input flow automation.
- c0nfused 9y agoI agree with headless chrome. I have used it with a locally hosted extension to allow easy access to dom and JavaScript after load. Then dumped results to a node app. Was very happy with the results.
- jdc0589 9y agoI had a ton of issues with JsDom historically. They could have been fixed, but Cheerio always worked out better for me.