3 ms·
Who said anything about using robot.txt for security? I just use it for keeping Google from indexing my print pages, for example. Anything that I don't want the
by pkulak 16y ago
Who said anything about using robot.txt for security? I just use it for keeping Google from indexing my print pages, for example. Anything that I don't want the world to see, can't be seen without authorization.