3 ms·
Yeah, why not? Index every page twice. If the non-bot result is materially different, rank the site lower. If the site is not accessible as a regular user, remo
by paxys 5y ago
Yeah, why not? Index every page twice. If the non-bot result is materially different, rank the site lower. If the site is not accessible as a regular user, remove it from results entirely.
- dylan604 5y agoWould you run that from different servers/IPs in case site owners attempt to deny pinky-swear-not-googlebot?
- deckard1 5y agoObviously. This is not some technical marvel we're talking about. Google already tells you how to verify the site visitor is Googlebot[1], practically telling the world how to do cloaking. Google employees know Quora, Pinterest, etc. are gaming their system. This has nothing to do with trivial technical solutions and everything to do with business incentives. [1] https://developers.google.com/search/docs/advanced/crawling/verifying-googlebot https://developers.google.com/search/docs/advanced/crawling/...