3 ms·
Presumably the site being scraped is getting some value from being included in Google's index. If they aren't, they can always opt out.
by criddell 7y ago
Presumably the site being scraped is getting some value from being included in Google's index. If they aren't, they can always opt out.
- dmitriid 7y agoFirst you have to find a way to prove it’s your data which isn’t trivial. Genius had to invent a watermarking system for texts: https://betanews.com/2019/06/17/google-genius-com-lyrics/ https://betanews.com/2019/06/17/google-genius-com-lyrics/
- Dylan16807 7y agoYou don't have to prove anything to opt out of indexing.