3 ms·
robots.txt has no legal standing by itself, but is a convenient way to translate "terms of service" (which do have legal meanings, but they're often more limite
by erroneousfunk 10y ago
robots.txt has no legal standing by itself, but is a convenient way to translate "terms of service" (which do have legal meanings, but they're often more limited than people assume) into something that bots can automatically understand. You're under no legal obligation to follow robots.txt, but it's a tool to prevent stepping on toes.
- Animats 10y agoThe "robots.txt" file has figured in two copyright cases.[1] Courts have taken notice of it as an indication of the web site operators's intent. [1] http://www.law360.com/articles/497068/the-role-of-the-robot-exclusion-in-copyright-defenses http://www.law360.com/articles/497068/the-role-of-the-robot-...