>I'd be surprised something more complicated like road navigation was 100% certain all the time. If for instance it failed to detect an obstacle how could it t

>I'd be surprised something more complicated like road navigation was 100% certain all the time. If for instance it failed to detect an obstacle how could it tell you that it failed detecting an obstacle? Or that it got the road markings wrong? Given that the consequences for making a mistake might be people dying I certainly hope that's not how it works under the hood. Anything less than "I'm absolutely sure that I'm not currently speeding towards an obstacle" should automatically trigger a safety system that would cause the autopilot to disengage and give the control back to the driver, maybe engaging the emergency lights to let the other drivers know that something is amiss. I wouldn't be surprised if in the moments preceding these crashes the autopilot algorithm was completely sure it was doing the right thing. Of course these various crashes show that in fact the algorithm makes mistakes sometimes but I certainly hope that it's not aware that it's making mistakes, it just messes up while it thinks everything is going as planned.