3 ms·
Not at all... that's a bit of a strawman since robots.txt/metatags are used by search engines and not the public in general. Not wanting your data on Google !=
by pdeuchler 14y ago
Not at all... that's a bit of a strawman since robots.txt/metatags are used by search engines and not the public in general.
Not wanting your data on Google != Denying access to said content