3 ms·
I would recommend using Headless Chrome along with a library like puppeteer[0]. You get the advantage of using a real browser with which you run pages' javascri
by marvinpinto 9y ago
I would recommend using Headless Chrome along with a library like puppeteer[0]. You get the advantage of using a real browser with which you run pages' javascript, load custom extensions, etc.
[0]: https://github.com/GoogleChrome/puppeteer https://github.com/GoogleChrome/puppeteer
- pteredactyl 9y agoI second this. I built using beautiful soup before and found Puppeteer much easier when interacting with the web. Especially nasty .NET sites.
- elyrly 9y agoSimple and straight forward, +1