3 ms·
The driver's response is moot. The larger issue here is that if autopilot doesn't provide for a safe stop under its own control when it encounters a situation i
by taneq 10y ago
The driver's response is moot. The larger issue here is that if autopilot doesn't provide for a safe stop under its own control when it encounters a situation it can't handle, any vehicle on autopilot becomes a lethal missile if the driver has some kind of medical problem.
A traditional car won't get more than a few hundred meters if the driver on the freeway has a stroke, say. A car on autopilot could travel hundreds of kilometers and end up in a schoolyard at freeway speeds.
- vkou 10y agoI hate to play Devil's advocate here, but a traditional car on cruise control will absolutely become a lethal missile if its driver has a stroke. I don't think automation makes that particular use case more dangerous.
- studentrob 10y ago> I hate to play Devil's advocate here, but a traditional car on cruise control will absolutely become a lethal missile if its driver has a stroke. You're talking worst case scenario. This is a case where the driver was alive and chose to ignore warnings. > I don't think automation makes that particular use case more dangerous. It's more dangerous when the autopilot driver can easily misuse the system. Add a few requirements like hands on the wheel every few seconds before shut-off and you'll see this happen less frequently. Someone may still circumvent that measure. Nothing's perfect. There will be fewer people who abuse it.
- vkou 10y agoAutopilot absolutely should start slowing the car down if the driver takes his hands off the wheel for more then a few seconds. Anything else is reckless. I was, however, responding to the specific scenario of 'Driver has a stroke --> Self-driving car becomes an unguided missile' by pointing out that it the exact same scenario as 'Driver has a stroke --> Regular car with cruise control becomes an unguided missile.'
- BigJono 10y agoAlso going to play devil's advocate here. Sure the car only goes a few hundred metres, but a slight knock of the wheel as they pass out or a small corner in the road could easily send said car into a crowded cafe. What is the chance that a Tesla car fails to continue safely and eventually pull over after the driver carks it? 0.1%? 1%? I doubt anywhere near 99% of strokes while driving end with the car just slowing down for a hundred metres and stopping safely in the middle of the road. I'd be surprised if the majority do. Not that it's a common occurance, but if I picture a typical stroke while driving alone, I'm picturing a car veering slowly off the road and hitting something at maybe 50-75% of the speed it was originally travelling. Tesla's self-driving would have to be abysmally bad to not beat that, and given we're only discussing 3 accidents so far, I don't believe that to be the case.
- taneq 10y agoI agree with your analysis of how far each vehicle will get - in fact that's why I say the car on autopilot is more dangerous. A conventional car with cruise control enabled will 'fail early' and crash in fairly short order (most likely running off the road into a crash barrier or something) if the driver stops controlling it. A car on autopilot won't crash for some undefined but probably long time, which means that when things do go pear-shaped, it's much more likely to be on the road and in a significantly different environment from where it was driving.