3 ms·I don't believe that robots.txt has ever had the backing of law.by sjg007 7y agoI don't believe that robots.txt has ever had the backing of law.