4 ms·
Except you always have a say in whether or not Google takes any part of your site. Google have always respected robots.txt and it's trivial to block your site,
by Asooka 8y ago
Except you always have a say in whether or not Google takes any part of your site. Google have always respected robots.txt and it's trivial to block your site, or parts of it, from being indexed and shown in searches.
- anilakar 8y agoExcept you won't be able to delist content without first allowing their crawler to rummage your site and returning 404 to Googlebot. Happened to me - I wanted to delist a single URL because it was generating unwanted traffic but still keep it accessible to those who have a direct link.