4 ms·
Doesn't this kind of also hurt SEO? I'm would guess Google has some automated system to detect and apply a negative signal to sites that provide different conte
by crazysim 11y ago
Doesn't this kind of also hurt SEO? I'm would guess Google has some automated system to detect and apply a negative signal to sites that provide different content to a Googlebot user agent than a non-Googlebot user agent. I guess these sites are counting that the other signals outweigh that negative hit.
Otherwise, why would expertsexchange be obligated to provide the answers at the very bottom? Did something change?
- eli 11y agoI'm 99% sure I've encountered a Googlebot crawling pages with the UA of a regular browser, presumably for exactly this purpose.
- chinathrow 11y agoThey do this via an iPhone like UA, though googlebot is still in there too.
- eli 11y agoI'm pretty sure that's just to see if the site is serving different content to mobile vs desktop. I think they also sometimes hit pages with no mention of googlebot.
- x0 11y agoIf you do an nslookup on the IP, it should come up with crawl-xx-xx-xx-xx.googlebot.com, where xx-xx-xx-xx is the IP.
- skocznymroczny 11y agoexpert sex change