Yeah, this is a good point. Most of the HN crowd understands that ML-powered autonomous vehicles will have crazy failure modes that no human would ever do. Prop

Yeah, this is a good point. Most of the HN crowd understands that ML-powered autonomous vehicles will have crazy failure modes that no human would ever do. Proponents of self-driving cars claim that the reverse is also true and that, on average, self-driving cars will be safer on average than humans – and that might be true! But it still matters that the humans remaining on the road can't predict what these things will do and our theory of mind won't work: even bad drivers are usually bad in predictable ways, but a software system that makes unexpected mistakes humans can't understand has second-order dangers on the road besides the ones it creates itself.