2 ms·So you wish you'd exercised the equivalent of a robots.txt?by calcnerd256 17y agoSo you wish you'd exercised the equivalent of a robots.txt?