3 ms·
Yeah, but if a driverless car does something stupid, people want an exact diagnosis ("sensor X failed", "the vision algorithm misidentified Ms. Whatsit as a pap
by taneq 8y ago
Yeah, but if a driverless car does something stupid, people want an exact diagnosis ("sensor X failed", "the vision algorithm misidentified Ms. Whatsit as a paper bag due to a bug on line 714", etc.) whereas a human driver can say "I thought they were going to brake" and we just accept that that's why the person did it.
- YeGoblynQueenne 8y agoThe difference is that neural nets are technologicl artifacts that we design and manufacture, unlike our own minds. We generally make sure that when we design and create such things, we know how to control them. For example, a car breaking system that randomly failed to stop the car under conditions that were impossible to understand would be unacceptable. When a component of a safety-critical system fails, we want to know why it fails. Not because we're curious, but because we want to avoid failure in the future. If the component is a black box that can't be reasoned about, then we can't know whether it will fail again in the future. Also: "Ms Whatsit"? In view of the Uber accident, that is extremely insensitive.
- AstralStorm 8y agoThe algorithm itself did not provide this diagnostic data, unlike a human who sometimes can. (e.g. was distracted by a phone; it was too dark; the person entered the street from between the cars etc.) Of course they can also lie. Blackbox data is always in need of careful interpretation.
- forapurpose 8y ago> whereas a human driver can say "I thought they were going to brake" and we just accept that that's why the person did it. We don't accept it. That person is cross-examined, doubted, their statement corroborated with other evidence - were they on their phone? What does the car telemetry say - when did they start braking? How fast were they going? What do witnesses say?