3 ms·
(disclaimer: i wrote that post) It is not. We rely on more than User Agents because they are too often faked, so it is not just marketing. There are other sign
by jcat123 2y ago
(disclaimer: i wrote that post)
It is not. We rely on more than User Agents because they are too often faked, so it is not just marketing. There are other signals we see that confirm whether the request came from a "legitimate" AI scraper, or a different scraper with the same user agent.
- PittleyDunkin 2y ago> There are other signals we see that confirm whether the request came from a "legitimate" AI scraper, or a different scraper with the same user agent. Great! What are these signals? That seems to be the meat of the post but it's conspicuously absent. How are we supposed to validate the post?
- signatoremo 2y ago> how are we supposed to validate the post? Imagine you were a vendor who were trying to trick the author into divulging his methods. Can a stranger on the Internet be trusted?
- dgfitz 2y agoI imagine if that information is disclosed, you won’t be able to verify it, as it will be bypassed… because it was disclosed.
- PittleyDunkin 2y agoWhat a wonderful world we live in where serious people are expected to believe press releases based purely on brand prestige.
- dgfitz 2y agoThere’s a lot of assumptions in that comment.
- superkuh 2y agoSo user-agent and whois to see if it's coming from a plausible netblock and accept: strings, http header stuff?