3 ms·

Does the robots.txt have any legal significance? I would think that the Terms of Use can be more thorough and are more legally relevant.