3 ms·

Because they aren't breaking any rules. You're allowed to show different content based on referrers, just not if the user-agent is googlebot.

• stingraycharles 10y ago
  So which content are you supposed to show to googlebot?
  • chipperyman573 10y ago
    The same content that you would show to other users. Googlebot's referrer is google.com, so it is able to bypass the paywall, just like anyone else clicking off google.com
    • stingraycharles 10y ago
      Right. So is the correct "fix" for this situation perhaps for googlebot to stop sending this referer?
      • chipperyman573 10y ago
        Google wants to see what the site will look like to someone who clicks to it from google, because that's what their users will be doing.