3 ms·
the hardest part of scrapping is bypassing Cloudflare/captchas/fingerprinting etc
by guluarte 1y ago
the hardest part of scrapping is bypassing Cloudflare/captchas/fingerprinting etc
- suchintan 1y agoDefinitely. What are your thoughts on the CloudFlare agent identity
- fragmede 1y agoThe hardest part is not telling anyone how you're bypassing it!
- ThatPlayer 1y agoI can talk about this bypass because they've fixed it: a site I was scraping rolled their own custom captcha that was just multiple choice. But they didn't have a nonce, so I would just attempt all the choices, and one of them would let me in.
- jimrandomh 1y agoThe captcha put you on notice that your scraping wasn't authorized. Depending on the details and circumstances, bypassing it and scraping anyways may have been a crime.