7 ms·
> "As road conditions became increasingly uncertain, the vehicle again alerted the driver to put his hands on the wheel," said Tesla. "He did not do so and shor
by taneq 10y ago
> "As road conditions became increasingly uncertain, the vehicle again alerted the driver to put his hands on the wheel," said Tesla. "He did not do so and shortly thereafter the vehicle collided with a post on the edge of the roadway."
If the autopilot's confidence was dropping that rapidly, why did it not slow the vehicle? If it hits zero confidence it should halt completely until the driver restarts the car in manual mode, and possibly disable itself until checked out.
- themartorana 10y agoThat could cause an accident just as easily.
- taneq 10y agoI'm saying it should gradually slow down as it gets more uncertain (just like you do in heavy rain as your visibility decreases), not that it should slam on the brakes with no warning. If gentle deceleration "causes" an accident then the problem is with the attitude and behaviour of the following vehicle, not with the deceleration.
- toomuchtodo 10y agoThat's the problem though: if its lost confidence, you might be gradually slowing down into a concrete median. You must ensure that the autopilot has enough confidence (while said confidence is diminishing quickly) to continue in the path it chooses safely between current speed and 0. Pretend we're in the car together. We're traveling at 70mph on a two lane road at night. I cover your eyes with my hands on a curvy road. Assure me we will stop in time without hitting something.
- dragonwriter 10y ago> [...] you might be gradually slowing down into a concrete median. Which seems to be less of a problem than not gradually slowing down as you run into the concrete median. Just as a human driver would, a road vehicle self-driving system needs to act sensibly to mitigate risk if its confidence in its ability to safely operate in the conditions it finds itself is reduced, until and unless a human driver has resumed active control.
- toomuchtodo 10y agoI think we agree, its simply in the execution. Why didn't the vehicle slow down when it lost confidence? Was it software? Could the ultrasound sensors and/or MobileEye camera not see the concrete median at night?
- readams 10y agoI think you'll find suddenly braking in the middle of the road poses its own dangers.
- toomuchtodo 10y agoAgreed, but Tesla might need to get more aggressive now ("Confidence lost, resume control, emergency braking") and have the tail lights go to 100% brightness before braking is applied (to give the driver behind them ample time to slow). The clue stick comes in many forms.
- ethanbond 10y agoIncluding "put your hands on the wheel" x2
- toomuchtodo 10y agoIf you're instructing the driver to do something, and they don't, your last option is to fail as gracefully as possible (which is "what is the best path forward in the distance I need to stop at emergency braking rate + I must notify the vehicle behind me as soon as its clear I will take automated action, even if that's before I apply braking force").
- ethanbond 10y agoThat's fair! I guess no one wants automated cars forcing those behind them to rear-end, but eventually it does have to make this sort of decision.
- morcheeba 10y agoGoing off-road like it did seems safer than stopping on a highway. Sure there was damage, but far safer for the unconscious* occupants than being rear-ended. (* I use "unconscious" because this guy was not paying attention, but also because it appeared to the car that the driver was dead)
- 10y ago
- satysin 10y agoThere is not a simple, one-size-fits-all solution to this. Ideally if AP confidence drops to a critical level what you want is for the AP to safely remove the car from the road however how and when do you do that for every possible situation that can be encountered on the roads? At the end of the day the driver has to take responsibility and take over the controls like it asks.
- kozak 10y agoIf something on the road becomes unclear to me, I drop speed immediately, and then do anything else. Lower speed gives you more time to think.
- yk 10y agoThing is, standing still on a highway is also not a safe place to be. So the car needs to determine a safe-fail state on its own.
- jacquesm 10y agoBut it is safer than ramming it into a lamp post or guard-rail. Ok, it is still a risk, and a bad accident may ensue. But most of the times there is a vehicle stopped on the road the traffic behind it simply stops as well, and in most places there is a hard shoulder that you can park on. It's not as if cars don't strand for other reasons (engine failure, driver incapacitation).
- oconnore 10y agoBecause this sort of auto->manual transition of control does not work [1]. 1: https://www.amazon.com/Our-Robots-Ourselves-Robotics-Autonomy-ebook/dp/B00SI02AWK https://www.amazon.com/Our-Robots-Ourselves-Robotics-Autonom...
- studentrob 10y agoAny notable quotes or stats from the book? I'd guess some of Tesla's stock value is tied up in the idea that the auto-manual transition of control does work.
- oconnore 10y agoI lent out my copy, but one particularly relevant section compares results from the aviation industry's use of pure-autopilot and HUD-augmented landings. Pilots maintain their flying skills, and get better overall results by staying in the loop with an augmented vision system. Good pilots often avoid full-autopilot entirely, or are forced to abort only seconds from touchdown, resulting in poorer landings. Bad pilots over rely on autopilot, and are therefore under-trained to deal with exceptional situations, resulting in incidents like the infamous Air France crash. https://youtu.be/4nDdqGUMdAY?t=183 https://youtu.be/4nDdqGUMdAY?t=183
- studentrob 10y agoCool. Tesla should review this book and talk. Paraphrasing a few quotes from your link ... "The most difficult challenging tech problem is not full autonomy, but rather the interaction between automated systems and humans" The subtitle of the book is also notable: "Robotics and the Myths of Autonomy" The speaker almost seems to be arguing that full autonomy is impossible. If we start up a system, then its behavior has still been kicked off and wrapped by humans. Interesting perspective. I'd like to read the book myself after listening to a bit of this talk. Thanks!
- ghaff 10y agoIt's not so much that full autonomy is impossible. We "fire and forget" many type of systems with no possibility of human intervention--at least not in a timely manner. What you can't do is start an automated process, comforting yourself that an inattentive human can always take over in a split-second if the automation messes up.