5 ms·
What if you're in the car that the self driving algorithm decides it's safer to crash and kill you than hit whatever it thinks it was going to collide with? Ed
by sizzle 8y ago
What if you're in the car that the self driving algorithm decides it's safer to crash and kill you than hit whatever it thinks it was going to collide with?
Edit- downvoters please state your beliefs, there is no right or wrong answer to points 1-7 below.
[1]
Imagine you’re in a self-driving car going down a road when, suddenly, the large propane tanks hauled by the truck in front of you fall out and fly in your direction. A split-second decision needs to be made, and you can't think through the outcomes and tradeoffs for every possible response. Fortunately, the smart system driving your car can run through tons of scenarios at lightning fast speed. How, then, should it determine moral priority?
Consider the following possibilities:
1. Your car should stay in its lane and absorbs the damage, thereby making it likely that you’ll die.
2. Your car should save your life by swerving into the left lane and hitting the car there, sending the passengers to their deaths—passengers known, according to their big data profiles, to have several small children.
3. Your car should save your life by swerving into the right lane and hit the car there, sending the lone passenger to her death—a passenger known, according to her big data profile, to be a scientist who is coming close to finding a cure for cancer.
4. Your car should save the lives worth the most, measured according to amount of money paid into a new form of life assurance insurance. Assume that each person in a vehicle could purchase insurance against these types of rare but inevitable accidents, and then, smart cars would prioritize based on their ability and willingness to pay.
5. Your car should save your life and embrace a neutrality principle in deciding among the means for doing so, perhaps by flipping a simulated coin and swerving to the right if heads comes up and swerving to the left if its tails.
6. Your car shouldn’t prioritize your life and should embrace a neutrality principle by randomly choosing among the three options.
7. Your car should execute whatever option most closely matches your personal value system and the moral choices you would have made if you were capable of doing so. Assume that when you first purchased your car, you took a self-driving car morality test consisting of a battery of scenarios like this one and that the results “programmed” your vehicle.
There’s no value-free way to determine what the autonomous car should do. The choice presented by options 1–7 shouldn’t be seen as a computational problem that can be “solved” by big data, sophisticated algorithms, machine learning, or any form of artificial intelligence. These tools can help evaluate and execute options, but ultimately, someone—some human beings—must choose and have their values baked into the software.
Who should get decision-making power? Should it be politicians? The market? Insurance companies? Automotive executives? Technologists? Should consumers be allowed to customize the moral dashboard of their cars so that their vehicles execute moral decisions that are in line with their own preferences?
1. https://motherboard.vice.com/en_us/article/j5a8d3/self-driving-car-policy-uber https://motherboard.vice.com/en_us/article/j5a8d3/self-drivi...
- bostonpete 8y agoThis is just FUD, and it's got nothing to do with the parent comment, which was talking about the lives that will be saved by widespread autonomous vehicles. Not sure why you decided to respond to that comment with your own variation of the trolley problem but you're being downvoted because the comment wasn't relevant. The fact that developers of autonomous systems have to consider the ethical and moral implications of their work is well understood, but these systems will still be much safer than human drivers.
- sizzle 8y ago"Not sure why you decided to respond to that comment with your own variation of the trolley problem but you're being downvoted because the comment wasn't relevant." Because it's the only aspect of autonomous cars that worries me and parent was talking about how much safer it will be. I know it's not rational from a statistical perspective and actually safer than human drivers, however on an intuitive human level it's hard to stomach that I may be algorithmically placed in harm's way.
- jon_richards 8y ago>on an intuitive human level it's hard to stomach that I may be algorithmically placed in harm's way. For the opposite, see "I, Robot". Spoiler warning. I initially thought of the main character's backstory (survivor's guilt over an algorithm rescuing him because he had a higher chance of survival than a little girl), but the main plotline is also about people being "algorithmically placed out of harm's way".
- azinman2 8y agoThat’s the only aspect that worries you? I’m far more worried about the infinitely long tail of edge cases, overhype of AI and artifically inflated trust that comes from it, increased car usage on the road when people would rather be ferried than take a ferry/public transit, decrease in ability to manually control machinery as a population... these all seem like certain critical issues that will affect masses rather than hypothetical trolly problems that will seldom occur but are easy to obsess over.