The comparison to autopilot is a good one, I agree, but the implication is just the same: it's potentially dangerous. The aviation had to address this issue ba

The comparison to autopilot is a good one, I agree, but the implication is just the same: it's potentially dangerous. The aviation had to address this issue back in the 80s and 90s, noting that simply failing to properly observe gauges or other indicators contributed to 31 of 37 airline disasters in the 80s: http://libraryonline.erau.edu/online-full-text/ntsb/safety-studies/SS94-01.pdf http://libraryonline.erau.edu/online-full-text/ntsb/safety-s... It remains an issue, and a very well-explored one that is extremely relevant to car automation. https://www.newyorker.com/science/maria-konnikova/hazards-automation https://www.newyorker.com/science/maria-konnikova/hazards-au...