2 ms·
Where I work we prefer jQuery to the native DOM API for scraping. It really speeds up the process of extracting data. For example with Puppeteer you can do pag
by paps 9y ago
Where I work we prefer jQuery to the native DOM API for scraping. It really speeds up the process of extracting data.
For example with Puppeteer you can do page.injectFile("jquery-3.2.1.min.js"). I think that would simplify your evaluate() calls.
It would also be easy to speed up the whole process by doing a single evaluate() call per page with all your scraping code in it.
BTW we just released an article with tips & tricks for Headless Chrome: https://blog.phantombuster.com/web-scraping-in-2017-headless-chrome-tips-tricks-4d6521d695e8 https://blog.phantombuster.com/web-scraping-in-2017-headless... What do you think?
- emadehsan 9y agoGood suggestion. I would update soon. Thank you