38 ms·
“While vehicles may react autonomously in the event of emergency situations, humans shall regain control during more morally ambiguous events.” That’s not goin
by azinman2 9y ago
“While vehicles may react autonomously in the event of emergency situations, humans shall regain control during more morally ambiguous events.”
That’s not going to end well. As we saw in the AZ crash, when there’s a situation at hand, it’s hard to transition the attention properly quickly over to a human who has been not paying attention because while the car was handling everything just fine. It’s unrealistic to think that’s possible in anything less than at least 10 seconds.
- Jommi 9y agoExactly, not to mention the definition of a morally ambiguous event is in itself already debatable and... morally ambiguous.
- qznc 9y agoThis isn't a law, just some guidelines. I'm not worried that details such as the handover time will be resolved in some industry standard. More interesting is the implication that this requires the possibility for humans to regain control. So we should not build cars without control mechanisms (steering wheel, brake pedals, ...)?
- Moru 9y agoIt's enough with a big red break-button on the panel that makes the car come to a complete stop as fast as possible.
- dotancohen 9y agoHow does that work on ice or snow? With a bus behind you? Or on a curving downgrade? With a trailer? With your unbuckled luggage or dog in the back seat? When the driving is easy, the AI _can_ do it. We are by default discussing the unusual, difficult situations.
- Moru 9y agoForgot the /sarcasm tag... The car industry is sick from the latest-trend-virus. Touchscreens does not belong, neither wheel-less. But I'm sure someone will see the wheel as a risk if you crash into something and remove it. That the wheel could have avoided the collision completely is not important.
- Moru 9y agoThat means the driver has to be in focus and control of the situation at all times, just like it is now. No blaming the machine or the maker of the machine.
- DannyBee 9y agoWhich is completely and totally unrealistic. In a fight between people writing down how they want things to be, and basic human psychology, the latter has won every single time.
- sametmax 9y agoExactly. As soon as autonomous driving is out, people will start using it to not pay attention. And because it will work most of the time, they will keep doing it.
- icebraining 9y agoNo, actually it doesn't. From the report: "In emergency situations, the vehicle must autonomously, i.e. without human assistance, enter into a “safe condition”." What they mean is that the driver should have the freedom to overrule the system, not that they must do so.
- Roritharr 9y agoControl could mean ahead of time. So basically the driver gets ahead of time a couple of gutwrenching morality questions like:"Would you rather crash into: 2 Kids on a bicycle or a woman with a stroller?" That's what I call an intense first-time-setup session.
- Normal_gaussian 9y agoTwo months later two kids cross the road in front of you; the system misidentifies an overflowing bin as woman and stroller and proceeds to plough right through the children. As this was a technical fault you suffer no legal repercussions, but carry the mental despair over whether you answered the setup question correctly to an early grave.
- TeMPOraL 9y agoThen the sharing model will win over ownership, and you spend most of the road time in rented self-driving cars. Your "first-time session" becomes saved as your morality profile, and each car you rent will use your morality profile to make decisions. Fast forward couple months, and your morality profile is yet another thing advertisers know about you.
- Vik1ng 9y agoThat event was not really morally ambiguous. Try to not hit the pedestrian/cyclist.
- pjc50 9y agoYes, this doesn't make any sense - there's no "morally ambiguous" situation that isn't an emergency. In practice the "hit X or Y" situations are extraordinarily rare. It is however worth trying to encode what happens in emergency situations to be as similar as possible to the local highway code, so you've got a sound basis for decisions. And it's very useful if the vehicle can "explain" its actions afterwards.
- MereInterest 9y ago> It’s unrealistic to think that’s possible in anything less than at least 10 seconds. I recall a study (and would be grateful if anybody has a link, as I cannot find it at the moment), which tested the reaction times and decision-making of drivers who had just been handed the wheel by an autopilot, in a simulated driving situation. What they found was that it took about 10 seconds before the drivers got up to the level even of a drunk driver. To me, that study indicated a fatal flaw in the entire concept of hanging control back to the human driver. If there is an emergency, it will be resolved in 10 seconds one way or the other. At that point, you can either have the confused computer trying to drive, or the even more confused human trying to drive.
- qwertox 9y agoYou made me google it. I hit an article stating about 26 seconds reaction time, in extreme cases up to 30 seconds. Add 1.6 seconds when you're reading a magazine, which seems a bit short to me. This was a study from the University of Southampton, probably done around February 2017. https://www.zeit.de/mobilitaet/2017-02/autonomes-fahren-auto-fahrer-reaktionszeit https://www.zeit.de/mobilitaet/2017-02/autonomes-fahren-auto...
- phyller 9y agoI think everyone is misunderstanding this. It is not saying that autonomous cars must stop driving in ambiguous situations. It is acknowledging that in clear emergencies driver inputs can be ignored, but once the emergency is over driver inputs must overrule software. For example, the car is driving me somewhere, and there is a wreck on the other side of the road. Foolish human nature takes over, I take control of the car to slow down and look at the accident. I am overriding the cars autonomous software. The car in front of me is doing the same thing, but slows down even more. My car senses a collision about to happen, and takes control by applying the brakes, ignoring my input on the gas. Once the clear danger is over, the car must give control back to me, but only if I continue to choose to override its normal operation. Otherwise it will resume driving itself. This is basically an application of Asimov's "three laws" concept.
- ythn 9y agoSeems like there would be new corner cases where "ignoring driver input" is bad, even if the car judges that it is an "emergency"
- RaceWon 9y agoAs a racer I have to wonder; do the people coding and developing these cars even know what is possible when an expert is at the controls of a car? I'm not saying that to be reasonably safe and/or viable these cars need to be piloted at a level akin to say a Mozart on the violin or a Peart on the drums, however that level of Genius is achievable. So again I ask: do you think the brain trust behind the R&D has any inkling of precision driving on the edge of adhesion? After all, it does rain and snow out on the Boulevard. BTW this is what a virtuoso can do in the most difficult car there is to drive, a Grand Prix car. And yeah, I loved the guy... so I picked a vid with some fluff. "https://www.youtube.com/watch?v=n9qZu7h5ys0" https://www.youtube.com/watch?v=n9qZu7h5ys0"
- phyller 9y agoI imagine that sports cars or modified cars will have a little switch where you can turn off all computer controls.