3 ms·robots.txt is not a legally binding document, nobody needs to actually respect itby throw-12-16 10mo agorobots.txt is not a legally binding document, nobody needs to actually respect it