3 ms·
> Does it turn a blind eye? Does the NYT trick Google by displaying something else to Google then to me? Pretty much this. Google used to have a policy called
by luckylion 7y ago
> Does it turn a blind eye? Does the NYT trick Google by displaying something else to Google then to me?
Pretty much this. Google used to have a policy called "first click free" that basically said "you can have a paywall, but a user must be able to see the first content they click on from a search result. for more content, you can make them sign up".
They dropped that policy at some point (and it was never really enforced, though many/most did follow it), so cloaking for paywall-purposes is okay now.
- frou_dh 7y agoNotably, that quirk was the impetus for the link called "web" under every HN submission. Which, in my experience, still does work more often than not to get around paywalls.
- ebj73 7y agoDo you know anything about how they're doing this? Is it special content in the http headers of the requests from Google? Or do they explicitly know which IP-addresses Google will be doing it's web crawling from?
- luckylion 7y agoIt's just a different version targeted at Googlebot. Google's IPs aren't secret, and Google is open about how to identify (and verify) their webcrawlers: https://support.google.com/webmasters/answer/80553 https://support.google.com/webmasters/answer/80553