3 ms·
And Selenium with clever clicking ? I never got why crawlers never took the approach to just be a slow human clicking around chrome.
by xwolfi 4y ago
And Selenium with clever clicking ? I never got why crawlers never took the approach to just be a slow human clicking around chrome.
- traverseda 4y agoAnyone looking into this, I'd recommend python-playwright. Good browser engines and the ability to hot patch every request means you don't need to write a separate proxy to intercept requests. Writing something like this would be a pretty big project, at least a few solid weeks of work for someone who knew what they were doing, and there's a lot of edge cases.