4 ms·
This feels like a really tricky question, actually -- what to do when an moving object is headed towards a stopped self-driving car? It's easy to say the car s
by crazygringo 9y ago
This feels like a really tricky question, actually -- what to do when an moving object is headed towards a stopped self-driving car?
It's easy to say the car should be smart enough to move -- but what if, as it moves in one direction, the object (like a truck trying to avoid the car) suddenly swerves in that direction too? Then does the car become responsible for the collision?
And of course, it feels like there could be a real-world version of the trolley problem [1] -- what if there are 5 occupants in the vehicle who will be killed by an oncoming truck, but in the only direction where it can move out of the way, it will have to run over a single pedestrian?
Glad I'm not the one having to make these kinds of programming decisions.
[1] https://en.wikipedia.org/wiki/Trolley_problem https://en.wikipedia.org/wiki/Trolley_problem
- dzdt 9y agoHonk!
- deleted 9y ago[deleted]
- deleted 9y ago[deleted]
- maxerickson 9y agoIt can't know that the truck is going to kill the 5 passengers so it can't take aggressive preventative action, it has to do the conservative thing, which is to move as much out of the way of the truck as is possible without hitting an object.
- CydeWeys 9y agoLay on the horn for starters. That's what I've done in a similar situation and it worked. Also, just back up a bit (also done that). It's not hard for a person or a self-driving car to ascertain that you're gonna get hit if you stay where you are but that if you back up a little bit while honking you buy yourself more room.
- Cthulhu_ 9y agoIn this case, it was a low-speed incident and the trucker was at fault. If the car didn't have the option to move backwards or avoid the incident without damage or injury, staying put is the best option. I don't see a problem here. Unless of course the truck was out of control and would've crushed the car. There should be an emergency exit option on cars like this though.
- Piskvorrr 9y agoThere isn't? https://mickybnovels.files.wordpress.com/2014/03/03-emergency-exit.jpg https://mickybnovels.files.wordpress.com/2014/03/03-emergenc...
- dkarl 9y agoI would guess that it's not a tricky question at all for the company, because the public reaction to a driverless car being hit while stationary is very different from the public reaction to a driverless car being involved in a collision while moving. People accept the former as a cut-and-dried situation but treat the latter as a he-said, she-said situation where they're free to project their own biases onto the situation. (Was the computer really not at fault? Like the globalist media would ever tell it straight when it comes to robots putting people out of work. Tech companies are never held responsible. Et cetera.) Also, this kind of story is new and interesting right now, so people will pay attention to the details, they'll make up their mind how to feel about later stories that they won't bother to read because it will be boring by then. It's amazing luck for the company to get in a "hit while stationary" story right at the get-go to help groove the narrative that driverless cars are safer than human drivers. From a public perception standpoint it would be so helpful (dons tinfoil hat) that you could almost imagine them arranging some accidents of that kind. I think it would be a dumb chance to take, so I don't believe that's what happened, but I bet they're fist-pumping over their good luck.
- cadab 9y agoYou might enjoy this podcast[1], they discuss this very issue. [1] http://www.radiolab.org/story/driverless-dilemma/ http://www.radiolab.org/story/driverless-dilemma/
- pjc50 9y agoThere was someone on twitter who very effectively demolished all this "trolley problem" speculation by pointing out two things: - the knowledge of the world held by cars is partial and probabilistic. As it is with real humans, only with very different obscure failure modes (see for example the "adversarial images"). - if you get into this situation, something has already failed. Either in your safety practice or someone else's. That reduces the predictability of the situation and also the predictability of what your actions will do in that case. Put those two together and you realise that any kind of "deliberate" (in the sense that one can impart "intent" to a computer system?) running over of a pedestrian is indefensible, and that real situations don't admit of neat counter-factuals like this.
- dmachinemoi 9y agolink? that’s an interesting point about probabilistic models and obscure failure modes, but what does that have to do with moral thought experiments?
- pjc50 9y agohttps://twitter.com/mcclure111/status/927999560697499648 https://twitter.com/mcclure111/status/927999560697499648
- corobo 9y agoYeah honestly I'd rather cars not have anything to do with trolley problems built in. Build in "Don't hit objects" with a fallback of "hit the brakes, horn, and do the robot equivalent of pray" if there's no swerve options available. My main concern with putting in code to handle trolley problems is what happens if (when) this code is tripped as a false positive? Some person walking along minding their own business when an autocar swerves into them because something on its radar looked like a crowd of people teleported in front of it
- Piskvorrr 9y agoSorry, that's just repackaging the problem and pretending it's fixed. The trolley problem is "there's something everywhere inside my stopping distance, we will inevitably hit something"; yours is only a possible solution for it: "Don't hit objects [evaluated as negative]" with a fallback of "hit the brakes, horn, and do the robot equivalent of pray [ok, gonna hit whatever is in front instead what's front left or front right]". TL;DR: Saying "let's have this one hardcoded solution to the trolley problem" does not make the problem disappear.
- pfortuny 9y agoIt should honk.
- smsm42 9y ago> what to do when an moving object is headed towards a stopped self-driving car? Nothing. Whoever is controlling that moving object is responsible. So, provided the car is not stopped on railroad track (in which case - what they heck is it doing stopping on railroad track?!) it should just stay there and not add variables to the situation by jerking around.