4 ms·
I read an interesting ethical dilemma related to self-driving cars recently. Imagine that a self-driving car detects a child in the road, and the only way to a
by pmoriarty 10y ago
I read an interesting ethical dilemma related to self-driving cars recently.
Imagine that a self-driving car detects a child in the road, and the only way to avoid hitting the child is to crash the car in to a wall, certainly killing the driver.
What choice should the car be programmed to make?
Who should decide what that choice is?
Who is ethically responsible for that choice?
In a normal car that is driven by a human, the choice is obviously made by that human and the responsibility is theirs. But with self-driving cars it's not so clear.
- shostack 10y agoTo further complicate it...would this be standardized? Would a cheap economy car opt to kill the driver, but a Mercedes try to preserve the driver at all cost? How much say would insurance companies that insure the automakers have? What about the government? Also, what level of information about how this logic works is necessary to share with a potential buyer to judge them sufficiently informed? I know I'd sure as hell want to know if there were scenarios in which my car would decide my life was not worth saving so I could do my best to never even come close to making one of those scenarios potentially possible.
- maxerickson 10y agoAnd what if the child's parents have paid Mercedes to avoid hitting their kid? You think you are safe in your golden Mercedes, but not when the kid's got Platinum Protection on his phone!
- canada_dry 10y agoOooh, so then maybe I'll be able to pay Mercedes (or more likely VW) to target the neighbors kids... I've never liked them little brats. ;)
- dchuk 10y agoThis is a variation of the classic ethical debate of the Trolley Car Problem: https://en.wikipedia.org/wiki/Trolley_problem https://en.wikipedia.org/wiki/Trolley_problem There is really no "right" answer in the absolute sense, but it's a great party trick to toss out there for a group of people to debate over.
- sixothree 10y agoIf it can differentiate between a child and an animal then it's smart enough to add move value judgments such as worth to society (maybe by age). I think the easiest rule is the owner of the vehicle is the most important asset to the vehicle.
- antisthenes 10y agoOther threads related to autopilot (mainly Tesla), with great posts that explained in detail why this problem is unlikely to arise in reality and that the resultant action undertaken by the system would be the same in both scenarios (e.g. apply brakes as hard as possible). IIRC part of the explanation was that a human is unlikely to make a qualified choice in a situation like this anyway, so programming a decision matrix based on the utility of the target into the crash avoidance mechanism is moot. Something like 99.999% of the safety benefit would be achieved by a faster brake response time.
- skuhn 10y agoIt's also pointless to worry about because the proposed dilemma greatly overestimates the ability of computer vision systems to determine what an object actually is. These systems are looking for obstacles and road contours. They don't know that the obstruction in the road is a human baby, let alone the composition of an adjacent wall.
- maxerickson 10y agoIf it can actually decide, it should probably just decide at random. Then we can adjust speed limits and move dumb walls and so on to reduce the deaths attributed to random selection by an autodrive system. Kind of like we do with deaths attributed to poor driving. (I say if in the first paragraph because you need at least 4 conditions to be true: the information to make the choice is available, the vehicle is sophisticated enough to make the choice, there is enough time to make a maneuver and there is not enough time to make a maneuver that saves everybody)
- jws 10y agoNot to nitpick your dilemma, there will always be a dilemma, but at any speed where children in the road are likely (<70km/h, 45mph), the driver of a modern car will have a 90% chance of survival against the wall. Cars really are much safer than they used to be even at the instant where you are meeting the wall. (Ok, I used a "head on collision" number because I couldn't find a wall number, but the physics are probably pretty close. Numbers from a New Zealand Ministry of Transport PDF from 2012: http://www.transport.govt.nz/assets/Import/Documents/_versions/4041/Speed-crash-facts-2012.1.pdf http://www.transport.govt.nz/assets/Import/Documents/_versio... )
- skuhn 10y agoWhat if behind that wall are a ton more babies? Now we'll have to put x-ray machines in self-driving cars too.
- oh_sigh 10y agoWhat if those ton of babies will grow up to form a neo-nazi gang that ends up being worse for the world than hitler was? Now we'll have to put future-detectors in self driving cars too.
- skuhn 10y agoBut what if the babies become neo-nazis from all the cars x-raying them to avoid hitting them?
- Dylan16807 10y agoIt's interesting philosophically. From an engineering point of view you can just hit the brakes and never swerve. Good enough.
- ams6110 10y agoApply the brakes and stay in the right-of-way. The fact that there is a child in the road is someone else's fault i.e. whoever is supposed to be supervising the child. Chosing to depart from the road would certainly be the wrong choice, since now you might hurt/damage something or someone that is minding its own business and is where it is supposed to be.