3 ms·
I am not a lawyer, but as I understand it there is some precedent in the US of intentionally ignoring robots.txt being unauthorized computer access, exposing yo
by jasonwatkinspdx 16y ago
I am not a lawyer, but as I understand it there is some precedent in the US of intentionally ignoring robots.txt being unauthorized computer access, exposing you to all the liability that entails (possibly criminal).
- c2 16y agoI'd like to see an actual case reference for this. I've never heard of ignoring robots.txt resulting in any kind of legal action. It would take a pretty big leap to go from robots.txt is advisory to ignoring it constitutes a criminal action.
- jasonwatkinspdx 16y agoInternet Archive was sued unsuccessfully. As I understand it a lawsuit is still in process against Google on the topic. So I guess the precedent is weaker than I thought, but still: tread carefully.