3 ms·
They do this via an iPhone like UA, though googlebot is still in there too.
by chinathrow 11y ago
They do this via an iPhone like UA, though googlebot is still in there too.
- eli 11y agoI'm pretty sure that's just to see if the site is serving different content to mobile vs desktop. I think they also sometimes hit pages with no mention of googlebot.
- x0 11y agoIf you do an nslookup on the IP, it should come up with crawl-xx-xx-xx-xx.googlebot.com, where xx-xx-xx-xx is the IP.