If the industry doesn't self-regulate (ie, following conventional rules and basic human courtesy) ... then it will be regulated by laws. So let me fix what you

If the industry doesn't self-regulate (ie, following conventional rules and basic human courtesy) ... then it will be regulated by laws. So let me fix what you said for you: > Robots.txt isn't a legal document, yet.