3 ms·
That you are willing to let other people die for the sake of increasing your convenience isn't very compelling. And I think that's also unnecessary. From what
by wpietri 8y ago
That you are willing to let other people die for the sake of increasing your convenience isn't very compelling.
And I think that's also unnecessary. From what I can tell about Waymo's approach, they are launching with something well below level 5, but where they cut over to a remote driver whenever the car is unsure. It's a smart approach, in that they can offer a level-5 service with level-3 technology. They've turned the technology cliff into a cost-optimization problem, which they can chip away at over time.
- quotemstr 8y ago> That you are willing to let other people die for the sake of increasing your convenience isn't very compelling. That's how we got the original automobile, and that's been a great benefit to the human experience. Everything is costs and benefits. In exchange for reducing the amount of very dangerous manual driving that people do, we plug in autonomous technology that's very good, but not perfect. It still saves lives overall. This idea that autonomous must be perfect or you're a murderer --- it's simplistic and counterproductive, and following this kind of absolutist thinking guarantees that we'll never get autonomous technology and that people will continue to slaughter each other with manually-driven vehicles. Taking an absolute stance against dangerous technology might seem good at first, but in the long run, it increases the sum of human misery. It's perfectionism, not autonomous, that's killing people every day.
- BurningFrog 8y ago1.25 million people die in human driven traffic per year, 37,000 of those in the US. SDCs should only need to beat that safety level, not be perfect.
- wpietri 8y agoI understand the theory, but good luck selling a car on the basis of "probably as safe as the average driver!" And good luck convincing the parents of some kid run over by Google that it's just one of those things. Note also that for many of those 37,000 deaths, a human is found culpable, often doing time. Who do you propose should do the time for autonomous cars? An engineer? Their manager? The CEO? In practice, our corporate accountability is such that nobody will pay any penalty. Maybe that's fine when, as with the 2008 financial crisis, the losses are abstract and distributed. But when it's the life of somebody's kid, somebody's mom, somebody's sister? That at best will be an extremely volatile situation. Especially if Google or Uber captures 20% of the self-driving car market and is now responsible for 37,000 * 0.20 = 7400 deaths per year, or about 20 per day.
- quotemstr 8y agoI would buy a car guaranteed to drive as safely as I do, except autonomously. I'd do it in a heartbeat, and millions of people would line up behind me. It's not lack of customer demand that's keeping autonomous vehicles out of the hands of the public. It's risk-averse bureaucracy.
- wpietri 8y agoWhat's being discussed is not driving as safely as you do. It's as safe as the average driver. Or, more accurately, a company claiming it's as safe as the average driver, which is why I said "probably". Most people consider themselves above-average drivers: https://www.psychologicalscience.org/news/motr/when-it-comes-to-driving-most-people-think-their-skills-are-above-average.html https://www.psychologicalscience.org/news/motr/when-it-comes... So it seems pretty reasonable that any car that just kills the same number of people as the population average (which includes drunk drivers, tired drivers, distracted drivers, etc) will be seen as worse as worse driver than the person purchasing the car. And I think it's a given that regulators, and the general public, who are the ones who will be hit by the self-driving cars, will see an automated car that only kills 37k people/year as a non-starter.
- BurningFrog 8y agoI wonder how many of those deaths anyone is punished for? My guess is under 10%. Mostly it's just considered an "accidental death" and life goes on, as I understand it. But I (fortunately) don't have much experience with this. The only possible solution is that the SDC and/or software manufacturer is legally responsible for any accidents the SDC causes. I think that coverage has to be part of the legal package for these things to ever be sold in the US. But that would be money, not jail time, of course. Fortunately the car(s) should have video and data logs from the event, so the evidence situation should typically be very clear.
- wpietri 8y ago> The only possible solution is that the SDC and/or software manufacturer is legally responsible for any accidents the SDC causes. [...] But that would be money, not jail time, of course. I don't think there's any "of course" there. As we see with the 2008 crash and the financial industry generally, corporate financial liability for the high-risk decisions of individual managers and execs doesn't do much to reduce systemic risk. For the managers, it's a "heads I win, tails you lose" play. The difference between banks and robot cars is that a banking failure just means slightly higher prices for the customers and/or slightly lower dividends for investors. Whereas with robot cars, in comes in funerals. Especially given the endemic low quality in the software industry, there's little doubt in my mind that unless "disruptors" face actual jail time, we'll see what is in effect scaled-up negligent homicide.
- pdonis 8y ago> SDCs should only need to beat that safety level And they can't as they current are, and won't be able to for quite some time. Also, what they need to beat is not the aggregate safety level, but the average reliability of human drivers. Not all deaths are due to driver error. And they need to beat it by a large enough margin that people will accept that they are more reliable. Finally, as another poster pointed out, there is the issue of liability. We know how to assign liability if a human driver makes a mistake. How do we assign liability if an autonomous self-driving system makes a mistake? I can tell you that, if I'm the human who owns the car and I'm still going to be held liable if the car's autonomous self-driving system makes a mistake, I'm going to be very, very hesitant about letting that system control the car, even if the statistics show it's more reliable than I am. At the very least I'm going to want to closely monitor what the system is doing--which of course defeats the whole purpose of having it. And if I'm an automaker and am going to be held liable if my self-driving autonomous system makes a mistake, even if a human driver is in the car and I can't control how they operate the system, I'm going to very, very hesitant about selling cars with that system, even if the statistics show it's more reliable than human drivers.
- BurningFrog 8y agoLike I said in the the other thread, it has to be the automaker that stands behind its product with a financial safety guarantee.
- pdonis 8y ago> it has to be the automaker that stands behind its product with a financial safety guarantee. And, as I said, if I were the automaker, I would be extremely hesitant to give such a guarantee with human drivers in the car whose operation of the systems I am unable to control. So cars with such guarantees would basically have to be entirely self-driving, i.e., human intervention not even possible by design. That is a huge increase in required reliability, not to mention a huge change in how cars are currently used. Which is not to say it won't eventually happen, just that such a liability regime would, I think, significantly increase the time it will take to get to ubiquitous use of self-driving cars.
- 6gvONxR4sf7o 8y agoMore than 10k of those U.S. people die from alcohol related crashes. Would you be happy with your car being just marginally better than a drunk driver? It could save so many lives! Okay maybe just drunk drivers are a bad comparison, let's look at all of those accidents. They aren't all drunk people. Turns out like 95% of them are due to similar human stupidity though. So unless you want your car to be better than a terrible driver, it doesn't have to just reduce accidents by a little, it has to reduce accidents by 95%. Otherwise you're advocating for the analogue of a lyft driver who is looking at their phone and only a little tipsy to replace you behind the wheel. Yeah maybe it'll decrease deaths, but I'm not buying one, nor am I advocating for legalizing the equivalent of a driver on their phone and kinda tipsy.