3 ms·
Why doesn't the example chosen, YouTube, use something like Cloudflare "anti-bot" protection or Google reCAPTCHA. When I request a video page, I can see the JS
by 1vuio0pswjnm7 5y ago
Why doesn't the example chosen, YouTube, use something like Cloudflare "anti-bot" protection or Google reCAPTCHA.
When I request a video page, I can see the JSON in the page, without the need for examining a heap snapshot.
- quickthrower2 5y agoBecause cloudflare, recaptcha etc. mean this is not general in possible. You need to quack like a normal user for it to work. If a site is really against scraping they could probably completely make it uneconomical by tracking user footprints and detect unexpected patterns of usage.
- datalopers 5y agoThey detect and block headless browsers just as easy.