3 ms·
>Yes AI scrapers can easily spoof user-agent, but they fall out of date as the browser updates. It’s a hell of a lot easier for a company to ensure that its sc
by thfuran 4mo ago
>Yes AI scrapers can easily spoof user-agent, but they fall out of date as the browser updates.
It’s a hell of a lot easier for a company to ensure that its scrapers all report the latest user agent string than it is to get everyone and their mother to update their browsers in a timely fashion.
- microgpt 4mo agoyeah but unless everyone is checking the version, if it's just a handful of websites checking it, they don't. and browsers forcibly auto-update