2 ms·
First of all, as I understand it anyone can access it, not just google. Secondly, if you don't want to be indexed by Google, there are better ways to do that (l
by thayne 6y ago
First of all, as I understand it anyone can access it, not just google. Secondly, if you don't want to be indexed by Google, there are better ways to do that (like a robots.txt). Finally, I suspect Google would be more interested in using this as a tool to figure out which sites not to index, because they have fishy (or phishy) certs, than trying to find obscure domains that have slipped under their radar.
- cle 6y agoI know there are mechanisms to customize Google’s crawler on a domain. That’s not what I’m objecting to, I’m objecting to the loss of control over my data.