4 ms·
> A large proportion of these bot countermeasures use javascript to determine if the request is coming from a crawler or a human (Javascript engine checks, font
by misterbowfinger 8y ago
> A large proportion of these bot countermeasures use javascript to determine if the request is coming from a crawler or a human (Javascript engine checks, font enumeration, WebGL and Canvas, etc.).
How effective are scraping countermeasures anyway?
- jd20 8y agoThey work pretty well for any scraper that's not using an actual browser with JavaScript engine. It keeps the riff-raff out. A dedicated person will eventually work his way around all available counter-measures, though.