3 ms·Is robots.txt compliance written into law anywhere?by 15155 10y agoIs robots.txt compliance written into law anywhere?