3 ms·
That's the basic principle. It's a tool to fight to crawlers that spam requests without cookies to prevent rate limiting. The Chinese crawlers seem to have adj
by jeroenhd 1y ago
That's the basic principle. It's a tool to fight to crawlers that spam requests without cookies to prevent rate limiting.
The Chinese crawlers seem to have adjusted their crawling techniques to give their browsers enough compute to pass standard Anubis checks.