4 ms·
That was my reaction. It seems like the article is saying two mutually exclusive things: - We cannot block them because we can’t differentiate legitimate traff
by JimDabell 2y ago
That was my reaction. It seems like the article is saying two mutually exclusive things:
- We cannot block them because we can’t differentiate legitimate traffic from illegitimate traffic…
- …but we can conclusively identify this traffic as coming from AI crawlers.
- xena 2y agoIt's a situation where it's difficult to tell for individual requests at request handling time, but easy to see when you look at the total request volume.
- chneu 2y agoIt's the behavior of the traffic in hindsight that's obvious. It's difficult to identify in the moment. This is by design. Getting caught isn't a big deal. Getting caught in the act is. As long as they get their data, it doesn't matter if they're caught afterwards.