3 ms·
I'm not sure why ignoring robots.txt or an IP block would violate criminal statutes. I'm not even sure why circumvention would violate civil statutes. Obeying
by ryoshu 16y ago
I'm not sure why ignoring robots.txt or an IP block would violate criminal statutes. I'm not even sure why circumvention would violate civil statutes. Obeying robots.txt is common courtesy. For IP blocks /and/ people that ignore robots.txt, I have years of logs I'd like to turn over to the proper authorities.