4 ms·
That's exactly what I thought too, not even " sort-of " it seems "without a doubt" against that policy. It seems really tricky for Google to enforce though. Wou
by blakesterz 8y ago
That's exactly what I thought too, not even " sort-of " it seems "without a doubt" against that policy. It seems really tricky for Google to enforce though. Wouldn't they need to send out bots crawling without the GoogleBot agent? That also seems wrong, somehow.
- Forge36 8y agoIt does seem wrong. I wonder if they could double crawl and penalize sites that throw up a paywal
- Mirioron 8y agoThey could add the ability to report sites that do this. That way there would be less sites to double crawl.
- saalweachter 8y agoIf I recall correctly, this rule is why googling for an article and then clicking on it from Google frequently works. The rule is something like "a user clicking from Google can't see something (meaningfully) different than what the Googlebot sees". So you can paywall direct traffic or links from Reddit or internal links, but that first one from Google is supposed to work.