2% is exactly the proportion I was trying to convey and it's plenty to make my point, which is that an automated system would surely be scrapped for killing hal

2% is exactly the proportion I was trying to convey and it's plenty to make my point, which is that an automated system would surely be scrapped for killing half that many people, even though it would be saving millions of lives. Systems that become safer by scaling back automation are anomalies. In general, efforts are better spent improving the automation. The man vs machine dichotomy is contrived anyway. We personify and blame machines as a scapegoat. I prefer to think of automated systems simply as tools, extensions of human capability. Tools don't screw up, we screw up making them or using them.