4 ms·
Furthermore, all bots worth their salt as far as threats go enable js and do everything they can to appear like a normal browser.
by sam0x17 3y ago
Furthermore, all bots worth their salt as far as threats go enable js and do everything they can to appear like a normal browser.
- azalemeth 3y agoI'd love to know if puppeteer passed that test (probably). I have had exactly this problem many, many times and it is incredibly frustrating.
- 20after4 3y agopuppeteer passes the test if you run it from a machine that already has a good cloudflare reputation score. Try it from an AWS instance and it definitely fails 100% of the time. (I've tried it, that's how I know)
- sam0x17 3y agoThere are github projects that are forks of things like selenium and puppeteer that are specifically designed to avoid detection for things like scraping google search results, etc.
- tick_tock_tick 3y agoThat's fine as processing the javascript increases the coast at-least.