4 ms·
>If you don't want an otherwise public URL indexed you must use robots.txt or equivalent. Which only blocks bots that respect the file...
by drivebyacct2 14y ago
>If you don't want an otherwise public URL indexed you must use robots.txt or equivalent.
Which only blocks bots that respect the file...