3 ms·
Ask HN: Are Paywalls allowed to show Google crawler full content but not users?
Today I noticed the Washington Post I'd quite naughty.
Even when you click through from a Google search, they still gate the article content behind a paywall. Clearly they fed the full article to Google bot and Google news, but then show a different page, sans article content, to web users.
Is this a violation of Google search policy? If yes, does Google even care enough to enforce it?
I think this sort of publisher behavior makes for a hostile and overall very poor user experience.
.. Especially when Wapo is already bankrolled by greedy Uncle Jeff. But I digress.
- lusbuab 4y agoSome news sites use certain Structured Data (schema.org, hasPart in combination with accessibleForFree:false) for that - telling crawlers about the content behind the registration wall / pay wall.
- WalterGR 4y agoHere’s Google’s documentation on that: https://developers.google.com/search/docs/advanced/structured-data/paywalled-content https://developers.google.com/search/docs/advanced/structure...
- wmf 4y agoGoogle has allowed this for years unfortunately.
- 2ICofafireteam 4y agoView their cached version.
- jamjamjamjamjam 4y agoBecome a robot and enjoy the benefits no captcha and no paywalls
- jzl 4y agoYou can't cloak, which means serving different content. https://developers.google.com/search/docs/advanced/guidelines/cloaking https://developers.google.com/search/docs/advanced/guideline...
- altdataseller 4y agoGoogle does not care. They make the rules - not follow them.
- arcastroe 4y agoYou may be interested in 12ft.io It tricks sites into thinking you are a search engine so you get the full site without paywall