3 ms·
So let's suppose you were riding in your self-driving car and the AI in charge of it encountered a trolley problem: The brakes had suddenly failed approaching
by chongli 8y ago
So let's suppose you were riding in your self-driving car and the AI in charge of it encountered a trolley problem:
The brakes had suddenly failed approaching an intersection and the car had the choice of either running into a group of five pedestrians crossing the street or slamming into the concrete wall to your right, killing only you. Which is the correct answer?
Now suppose it was not you in the car but your wife and two daughters. Would you want your car, the car you bought and paid for, to sacrifice your family to save the lives of five strangers? What if it were only four strangers? Or ten?
There is no right answer. But as humans we're biased to favour, if not our own lives, the lives of our closest family members over strangers. I, personally, would never buy a car if I knew it would make the choice to sacrifice my family to save strangers.
- sokoloff 8y agoYes, I agree humans are selfish. Given the enormous number of situations where personal or in-group selfishness would confer a survival and propagation advantage, it would be surprising if we didn't have it. I hope we don't take explicit pains and effort to encode this into ML/AI systems. Concretely, the car should take the course of action to minimize the global harm based on the knowledge it has. If that's killing me in the event of a brake failure, so be it. The spectacularly unlikely probability of that is outweighed by the million more times when it and others like it will make a less selfish decision than today's human drivers. > I, personally, would never buy a car if I knew it would make the choice to sacrifice my family to save strangers. The point I find interesting here is "this consumer preference, if common, confers a propagation advantage to systems which behave selfishly".
- justtopost 8y agoBut should we be deprived of our instinct? Should we not get to apply our own personal ethics to our lives in the future, for the greater good? Its not a welcome encroachment on free will, even if it may be net positive from an objective view, removing the sense of agencey from humanity may end up hurting us worse.