3 ms·
They failed to present data that exceptions are made for other search engines.
by zerotolerance 6y ago
They failed to present data that exceptions are made for other search engines.
- greatjack613 6y agoValid point, but I do not think they are lying, I am sure they can present it to cloudflare if required.
- joshuamorton 6y agoIt's quite likely that Baidu is doing the reasonable thing and using a more sophisticated crawling mechanism to cache the cookies. You have to do this anyway to be able to crawl much of the web which is highly js-dependent.