6 ms·
Google probably crawls with non-Googlebot User-Agent strings periodically to test if sites are serving different content to Googlebot and regular browsers.
by cpeterso 6y ago
Google probably crawls with non-Googlebot User-Agent strings periodically to test if sites are serving different content to Googlebot and regular browsers.
- SolarNet 6y agoBut this mitigation would still fail. They might test for different content, but they probably don't include a periodic test like this in their timing tests, and if they did, it would just be an outlier.
- Quekid5 6y agoI have no insider knowledge, but I'm going to guess that they even crawl using actual Chrome browsers once in a while... and penalize deviations from what you serve to the GoogleBot... and also factor in response times for either. I don't think any single person can predict/know what's actually going on at this point.
- LeonB 6y agoIn google search console, you can see lighthouse data reported from actual google chrome instances of real users. (I can’t verify this right now)