4 ms·
Correct me if I'm wrong, but wasn't there a long standing Google's policy that the version of the page served to their crawler must also be publicly accessible.
by eps 11y ago
Correct me if I'm wrong, but wasn't there a long standing Google's policy that the version of the page served to their crawler must also be publicly accessible. That would then be the reason why WSJ articles were accessible through the paste-into-google trick, rather than because WSJ was incompetent and failed to "fix" the bypass.
So does it mean that Google will no longer index full WSJ articles or does it mean a change in the Google's policy?
- morgante 11y agoYou are correct, Google requires that you let users see the first click for free if you want to index content behind a paywall. [1] Since this is billed as an "experiment" I'm guessing that WSJ is just testing the waters. If they roll it out to everyone, they will have to serve only snippets to Google or risk getting delisted. [1] https://support.google.com/news/publisher/answer/40543?hl=en https://support.google.com/news/publisher/answer/40543?hl=en