3 ms·
I agree, but I usually get around it by going the URL from Google and the referral from Google will work. I really have no idea why this doesn't get them de-lis
by eeeeeeeeeeeee 10y ago
I agree, but I usually get around it by going the URL from Google and the referral from Google will work. I really have no idea why this doesn't get them de-listed from Google.
- chipperyman573 10y agoBecause they aren't breaking any rules. You're allowed to show different content based on referrers, just not if the user-agent is googlebot.
- stingraycharles 10y agoSo which content are you supposed to show to googlebot?
- chipperyman573 10y agoThe same content that you would show to other users. Googlebot's referrer is google.com, so it is able to bypass the paywall, just like anyone else clicking off google.com
- stingraycharles 10y agoRight. So is the correct "fix" for this situation perhaps for googlebot to stop sending this referer?
- chipperyman573 10y agoGoogle wants to see what the site will look like to someone who clicks to it from google, because that's what their users will be doing.