3 ms·
This has been possible for a long time with any browser using Selenium for example. It has APIs and client libraries for many languages. Also using a real brow
by codedokode 9y ago
This has been possible for a long time with any browser using Selenium for example. It has APIs and client libraries for many languages.
Also using a real browser brings a lot of problems: high resource consumption, hangs, it is unclear when the page has finished loading etc. You have to supervise all browser processes. And if you use promises, there is high chance that you will miss error messages because promises hide them by default.
- webfolder 9y agoSelenium is not suitable for website crawling. cdp4j is more suitable for this kind of works. https://github.com/webfolderio/cdp4j https://github.com/webfolderio/cdp4j