>robots.txt compliance is not difficult to build. I'm fine with robots.txt violations being considered hacking. I'm not. You can set up a server to serve diffe

>robots.txt compliance is not difficult to build. I'm fine with robots.txt violations being considered hacking. I'm not. You can set up a server to serve different versions of robots.txt to different folks. A malicious actor could deliberately feed inputs to a specific crawler that convince it to violate the terms of the robots.txt it serves to everyone else, and then press for criminal charges against the operator of the scraper. In a sufficiently adversarial relationship, this lets website owners turn any well-behaved site scraper into criminal activity. That's not a power we want to grant.