2 ms·
Google is indexing public pages as "someone" who does not have any specific access. Google has chosen not to know or care whether I have special access, and ind
by PeterisP 5y ago
Google is indexing public pages as "someone" who does not have any specific access. Google has chosen not to know or care whether I have special access, and index the content as if it's not there - perhaps it's a disservice, but that's the service they're offering to their users. And the actual news sites do not and should not have any say in this, the decision of what to index and what to show to users should remain between each search engine and their users.
So if a search engine chooses to index the "content-as-if-you're-anonymous-and-not-logged-in" and if you try to trick this service into showing something else than what's actually published to everyone (serving visitors and search engines different content), then it's quite reasonable for google to treat it as a cheating attempt (because, really, it is one) and choose to penalize it in their search policies - because that's what I as a search engine user would want.