10 ms·
Self-driving cars have to be at least as safe as human-driven ones for them to ever become accepted and thus widespread. Realistically, they need to be many ti
by CydeWeys 9y ago
Self-driving cars have to be at least as safe as human-driven ones for them to ever become accepted and thus widespread. Realistically, they need to be many times safer than human-driven cars for acceptance. It doesn't matter who's technically at fault; they cannot cause more deaths than human drivers. Everyone makes mistakes and they don't deserve to be killed by an algorithm for it.
- TheGRS 9y agoProbably the best point I've seen made by this. Humans are not computers and will do illogical things like jay walk across busy streets. Can't say I know the details for this particular situation, but many times a driver will see the telltale signs that someone is about to run across the street before it happens.
- scaryclam 9y agoHazard perception is actually a part of the driving test in the UK. They make candidates sit in front of a computer, watch clips of situations and click the mouse when they think there's a dangerous situation developing.
- Rapzid 9y agoI don't think "deserves" belongs in the discussion. It's an unpopular opinion, but I believe the pedestrian caused this situation by putting themselves in a dangerous situation and not paying attention. That can get you killed in many situations regards less of if you deserve it or not. I agree mostly with what you are saying, just not the undertone that this infortunate accident is somehow evidence of AVs "causing" more deaths than human drivers.
- bdcravens 9y ago> I believe the pedestrian caused this situation by putting themselves in a dangerous situation and not paying attention That's the thing - every driver has faced those situations, hundreds, thousands of times. Odds are very good a failure one of those times would have significant penalty for any driver, even if it wasn't their fault.
- the_grue 9y ago> It's an unpopular opinion, but I believe the pedestrian caused this situation by putting themselves in a dangerous situation Interesting! What reasons do you have to think this is an unpopular opinion? To me, it sounds like an obvious conclusion.
- CamperBob2 9y agoAs you're noticing, you get modded down to goatse.cx territory on here for suggesting that it might actually not be a good idea for pedestrians to step into traffic without looking. You also get nastygrams from the admins for posting what they judge to be off-topic material or flamebait. I don't get it either, but HN is what it is. Yes, this should have been an easily-avoidable accident for any autonomous vehicle that's permitted to use public roadways. No, no one has a good excuse for what happened, including Uber, its engineers, or its attending driver. Yes, the pedestrian was either intoxicated or suicidally stupid. No, the vehicle shouldn't have hit her, and yes, it's very unfortunate that it did. Now let's find out why it hit her and fix it. Because several other people probably died in human-caused auto accidents while I was typing this post.
- lostlogin 9y ago> Yes, the pedestrian was either intoxicated or suicidally stupid. Or they made a mistake or were distracted, like millions of people every day.
- CamperBob2 9y agoWatch the video. The victim was not "distracted."
- CydeWeys 9y agoPeople put themselves in dangerous situations all the time. I don't believe for one second that you've never made a traffic mistake in your life, either as a pedestrian or as a driver. But you've been fortunate to be surrounded by others who'll pick up the slack for your mistake and will yield even if they don't have to if it will prevent an accident. The traffic rules don't matter nearly as much as the outcome of people not being killed. Traffic rules are just a means to an end. So yes, it's quite possible for autonomous vehicles to cause vastly more deaths than human drivers even while being slaves to the rules. Hell, you could do it too as a human driver if you removed your conscience. Just don't hit the brakes the next time you have the right of way and a jaywalker steps out in front of you. You'll easily kill someone within a week and have it be their "fault".
- firebones 9y agoYou're onto an important theme: so much of driving is really about group communication--everything from signaling to anticipating behavior based on your own past actions, to waving people through intersections or slowing down to let someone merge or speeding up to make your intent more clear, or hanging back when the traffic gets stupid, or avoiding drivers who seem irrational. That's why I think the real self-driving car problem is a very special case of the Turing Test--one that might be more difficult to win or solve.
- kayoone 9y agoMost higher end cars already have assistant systems that prevent you from running over people or into unexpected obstacles. The problem here seems to be that Uber disabled some of those systems that the Volvo base car normally has.
- dragonwriter 9y ago> It's an unpopular opinion, but I believe the pedestrian caused this situation by putting themselves in a dangerous situation and not paying attention. That doesn't mean that the Uber system wasn't dangerously defective and that a fit foservice self-driving system would have noticed in time to react (which may not have been sufficient to avert a collision, and may not have prevented a fatality, but given the speeds involved would have significantly reduced the risk of fatality. That the pedestrian should not have entered the roadway where and when they did may relieve Uber of legal liability for this collision, it doesn't stop the failure to react at all from being evidence of a critical safety flaw. And, had the same thing happened at an equally poorly lit, not specially marked, intersection in many jurisdictions (including California, not sure about Arizona), Uber would be legally at fault because of pedestrian right of way. If Uber's system can't see and react to people in dark clothes at night, it's not even remotely suitable for use, at least at night.
- Symmetry 9y agoOthers are making good points but also, if the system can't be trusted to detect a pedestrian in these circumstances we can't be sure this bug wouldn't allow it to hit a stalled car or large piece of debris in the road either. Even if the car had just hit the bicycle and missed the woman this would be an utterly unacceptable level of performance for an AV to display after completing closed track testing.
- yerasame 9y agoI think in this particular incident, though, there was a human behind the wheel who also failed to react to the pedestiran.
- CydeWeys 9y agoThe "human safety driver" concept is inherently flawed and is incompatible with the way our minds are wired. You cannot have a person sitting still in bored inaction for hundreds of hours in a row and expect them to remain attentive enough for a split second reaction in an emergency situation. So yes, I am discounting the safety driver entirely. Autonomous cars need to drive themselves safely. That person was in the driver's seat as a scapegoat in reserve.
- bkor 9y ago1) On average the Uber car had to be intervened every 20 km or so. That's every 20-30min. If it happens that often, the additional driver would have to be doing something regularly during the day. Not looking so often at the road is dangerous. Uber should've been monitoring for this as well, just like they do with train drivers. 2) The train drivers in Europe are specifically hired to do just that. The ones in Netherlands are tested yearly. They're put on suspension when they run a red sign. Every so often they have to go through a special test for their attention span training. Uber obviously didn't do any of that.
- Consultant32452 9y agoI'm going to say something that I suspect many will quietly agree with but may not be willing to say out loud. I'm confident that self-driving cars will eventually be safer than human driven ones. I'm not confident that this can be realistically achieved without killing some unfortunate bystanders in the process of getting to that point. That doesn't mean we should accept these cars running amok killing people all over the place. It doesn't mean I think this specific case involving Uber is "reasonable" either. I just think, in a general sense, a realist has to be able to try to find some balance between short term lives lost and long term lives saved.
- mcny 9y agoI absolutely agree that some lives will be lost in the name of progress. I also hate the NIMBY ism showing up in these threads. However, I don't care for Uber or its ambition. I'm more worried that Uber's negligence will set the whole industry back with a public backlash.
- scoggs 9y agoI think the most uncomfortable part that people won't bring up is the fact that cars are essentially high speed, high weight metal death machines on wheels. Just a quick Google search and the first results give me this info: >Nearly 1.3 million people die in road crashes each year, on average 3,287 deaths a day. An additional 20-50 million are injured or disabled. More than half of all road traffic deaths occur among young adults ages 15-44. From this page: http://asirt.org/initiatives/informing-road-users/road-safety-facts/road-crash-statistics http://asirt.org/initiatives/informing-road-users/road-safet... Of course unmanned driving tests will happen at a very, very small fraction of the amount compared with manned drivers we have to pull stats from but I don't think it will take long, if the unmanned tests persist enough to conjure up the required amount of data needed to make a legitimate comparison to prove that unmanned driving will be markedly safer.
- selectodude 9y ago>Over 90% of all road fatalities occur in low and middle-income countries, which have less than half of the world's vehicles. The only person who died in a road fatality in phoenix that day was killed by a self driving car.
- olalonde 9y agoIt's hard to say for sure but the released video[0] makes it seem like most human drivers wouldn't have avoided the pedestrian in time. [0] https://www.youtube.com/watch?v=pO9iRUx5wmM https://www.youtube.com/watch?v=pO9iRUx5wmM
- deleted 9y ago[deleted]
- sfifs 9y agoHuman eye's dynamic range perception in the dark is far superior to the poor quality video camera that was released. The woman had crossed two lanes of the road before coming in front of the car - ie. fairly unrestricted range of view. A human driver paying attention would almost certainly have seen her and stopped or at least slowed down to a level where this would not have been a fatality.
- bkor 9y agoAside from that, the LIDAR did see the person. The system just didn't respond at all.
- smileysteve 9y agoI regularly drive 50mph on unlit roads in a rural setting where a deer could walk out at anytime -- and I hope that I can swerve and brake to miss it -- or at least slow down. No excuse for a modern car at only 38mph.
- Houshalter 9y agoThe first cars killed way more people than horses and they didn't get banned.
- sfifs 9y agoThe governing system in the world at that time was not really universal democracy. It was mostly rule by the rich (who bought those cars) even in places which were ostensibly democratic.
- majewsky 9y agoSoooo like today?
- nugi 9y agoBut this is untrue. Many regs were in play due to wagons, that applied even to the rich. Do you have a source, or just playing identity politics?
- sfifs 9y agoSure. In most of the Western world, Universal Suffrage came only after World War 1. Till then there were generally barriers of class, race or gender on who could vote. https://en.m.wikipedia.org/wiki/Universal_suffrage https://en.m.wikipedia.org/wiki/Universal_suffrage
- Houshalter 9y agoThat's not "rule by the rich". The middle class and even much of the poor still voted. You just had to own land, which isn't exactly a high barrier. The point was voting should be one vote per household, by the head of the family.
- nicky0 9y agoThe first cars had to have a man with a flag walk in front of them when passing through towns.
- shafyy 9y agoSure, but aren't they already if you look at the accident per total miles driven ratio? Of course, there will be accidents and people will die. People die every day in car accidents.
- slavik81 9y agoNo, Uber's self-driving vehicles are significantly more deadly on a per-mile basis. That's the whole problem.
- shafyy 9y agoI'm not talking about Uber. I mean in total across companies (incl. Waymo).
- slavik81 9y agoThe human driver fatality rate is roughly 1 per 100M miles. There has been 1 fatality with less than 20M self-driving miles across all companies. So, if you group all the companies together, they are still more dangerous than human drivers. But frankly, I think grouping Uber together with more responsible companies does the whole industry a disservice.
- lostlogin 9y ago> Self-driving cars have to be at least as safe as human-driven ones for them to ever become accepted and thus widespread. Do they? There are other technologies that started out less safe but were accepted and became safer after acceptance, further boosting their popularity. Planes and cars would be examples and mills in the industrial revolution, but there are undoubtably others.
- stctgion 9y agoBoth of those examples occurred at a time when human life held less value
- lostlogin 9y agoGood point. I’m struggling to think of a recent example but maybe smart phones? How you would find stats on deaths due to smart phones though? Obviously lives have been saved with them too, but the number lost due to distraction must be considerable.
- gambiting 9y agoMachines cannot have an operating mode where they can kill someone, even if in the grand scheme of things they are saving lives. Prime example: Therac radiotheraphy machines - it's without a doubt that these machines have saved countless lives, but they had a weird error state where instead of treating the patient, they would kill them instead. At that point we didn't go "oh well, a human operated radiotherapy machine would have killed more people because humans are inherently worse at this stuff" - we banned all of them until the problem could be found, rectified, the solution tested and implemented. It also contributed to much stronger industry testing standards for medical devices. I'd say an automonous car which can completely fail to react to a person in its path is firmly in the "therac-level of failure" category - even if on average they crash much less than humans do. They should all be taken off road and only allowed once we determine through rigorous industrial-level proof testing that it can't happen again.
- lostlogin 9y ago
- xiphias 9y agoThe main problem Uber has is that Waymo is already much safer driver than an average driver, and extending aggressively. It is an existential risk for Uber.
- bambax 9y ago> Realistically, they need to be many times safer than human-driven cars for acceptance. Yes, many times yes. The promise of self-driving cars is that they are totally safe, that is, nothing will happen except in exceptional, unforeseeable circumstances. The reason for this is, in a self-driving car, nobody's in charge, and therefore, any incident (let alone, a fatal accident) is immensely more complicated than the same incident with a human driver. (It's obvious that a self-driving car with a safety driver at the wheel doesn't provide any benefit whatsoever and isn't, in fact, a self-driving car). A self-driving car needs to: - transport people who are unable to drive or are "irresponsible" in the legal sense (kids, seniors, drunk people, injured/sick people going to the hospital, etc.) - drive itself with absolutely nobody onboard The analogy with trains is flawed because trains have drivers that deal with problems when there is one. Even "autonomous" metro trains are monitored individually. In fact, save for special conditions like a closed network on a campus, etc., I'm less and less sure self-driving cars will ever be a thing.
- kmonsen 9y agoIt will be a thing, at least in the US where in many places public transport is close to non-existing. It could take a long time outside limited "safe" areas.