3 ms·
Cloudflare's protection is quite a b*tch to circumvent with any headless or python library.
by marban 5y ago
Cloudflare's protection is quite a b*tch to circumvent with any headless or python library.
- password4321 5y agohttps://news.ycombinator.com/item?id=28514998#28515629 https://news.ycombinator.com/item?id=28514998#28515629 > Cloudflare's bot protection mostly makes use of TLS fingerprinting, and thus pretty easy to bypass. https://news.ycombinator.com/item?id=28251700 https://news.ycombinator.com/item?id=28251700 -> https://github.com/refraction-networking/utls https://github.com/refraction-networking/utls Disclaimer: haven't tried it.
- alphabet9000 5y agowith node, i've had success with puppeteer-extra using puppeteer-extra-plugin-stealth
- heavyset_go 5y agoIt's a pain even when you aren't a bot. For a while there, Cloudflare's fingerprinting page would trigger Firefox on Linux to crash instantly.
- omneity 5y agoSlight aside: The most recent Cloudflare HCaptchas ask you to classify AI generated images. They don’t even look like a proper bike/truck/whatever (I don’t have an example handy). I categorically refuse to do when I’m browsing websites using it. I find this new captcha utterly unacceptable. It’s no “protection” at this point anymore. Websites are using it as an excuse to become even more user hostile. I am worried for the future of the web.