4 ms·
It’s been received wisdom until now that Google penalizes websites which behave differently when scraped by the Googlebot. Is that no longer the case?
by sethaurus 6y ago
It’s been received wisdom until now that Google penalizes websites which behave differently when scraped by the Googlebot. Is that no longer the case?
- SXX 6y agoPinterest has proven by spamming SERP for years that if you're big enough Google will close eyes on it.
- syshum 6y agoThat applies to more than just google If you are big enough, there are separate rules for you (or no rules)
- smarx007 6y agoThey will serve same content to users with JS enabled and legit Googlebots while blocking clients w/o JS and bots. I don't think it violates Google rules but ofc is of questionable decency.
- ec109685 6y agoAnd Google can verify by crawling the site with and without JavaScript. Also, google has a commercial relationship with them: https://www.convinceandconvert.com/social-media-research/twitter-partnership-with-google/amp/ https://www.convinceandconvert.com/social-media-research/twi...