3 ms·
It seems like there should already be an industry term for this, it's like the autonomous systems version of the "uncanny valley" [0]. https://en.wikipedia.org
by pengaru 7y ago
It seems like there should already be an industry term for this, it's like the autonomous systems version of the "uncanny valley" [0].
https://en.wikipedia.org/wiki/Uncanny_valley https://en.wikipedia.org/wiki/Uncanny_valley
- missosoup 7y agoThere is in aviation. It's called handoff latency. It's the time between autonomy giving up and asking for intervention, and the time when something bad might happen. In aviation this is measured in minutes, worst case tens of seconds. In cars, it can be sub-second and humanly impossible. This latency is why an autonomous car that works 95% of the time is more dangerous than driving manually. I haven't seen any indication that this problem is possible to solve until we get cars to 99.999%.
- lukebuehler 7y agoVery interesting, I did not know that! Although, having flown planes myself, it makes sense. You can afford a few second of inattentiveness. Same with boats. But not in cars.
- ghaff 7y agoIf you haven't listened, it's worth checking out Children of the Magenta on the 99 Percent Invisible podcast. There's also a lot of interesting research from Missy Cummings' Humans and Autonomy Lab at Duke. https://hal.pratt.duke.edu/ https://hal.pratt.duke.edu/ She's been very critical of a lot of self-driving systems that mostly work but still require drivers to pay attention. (She's also a former US Navy fighter pilot.)
- falcolas 7y agoWell, I think that one problem is that the automation is not giving up; there is not handoff occurring. It's reporting "all's well" until fractions of a second before the crash, if that. This means that it's up to the human to remain constantly vigilant and identify abnormal situations. Of course, when you consider that an overhead road sign and a stopped semi trailer "look" the same to the systems involved, it's not surprising that they think that everything's OK.
- jazzyjackson 7y agoAviation also has a term "Children of the Magenta" [1] to describe pilots who only ever use autopilot -- the sense is, when the task is automated, you don't get practice using it manually, so in an emergency you have no experience of actually being in control. I expect autopilot cars could follow similar regulations as aircraft: "if you want to keep your license, you can prove you've driven in manual mode for x hours every month", where x is enough to know how to control the car in an autopilot disengage. [0] https://99percentinvisible.org/episode/children-of-the-magenta-automation-paradox-pt-1/ https://99percentinvisible.org/episode/children-of-the-magen...