5 ms·
It's absolutely irrelevant if it crashes "less" than a human driver. It just cannot fail to detect an obstacle in front of it to be allowed on the road, period.
by gambiting 9y ago
It's absolutely irrelevant if it crashes "less" than a human driver. It just cannot fail to detect an obstacle in front of it to be allowed on the road, period. If there is any edge case where that can happen, then the car shouldn't be certified as safe to use. Like, I don't understand how it's not obvious. A heart surgery machine that kills the patient every once in a 1000 operations would be taken off the market faster than you can say "litigation", even if a human surgeon has a worse survival rate(say 1 in 100 operations, so lets say the machine is an order of magnitude safer). That has already happened with radiotheraphy machines, there was a model that on average definitely saved lives but it had a failure mode where it would kill a person. Would you continue using it? Of course not.
Or airplanes - autopilot in planes has contributed tremendously to improving flying safety, but every time there is a crash under autopilot both Boeing and Airbus will ground every single plane of the same type to figure out the cause, they don't just go "oh well, it's still safer than flying manually so it's good for us".
I really don't understand this notion that an autonomous car merely needs to be "better than average driver" to be allowed on the road. Absolutely disagree here.
- Tade0 9y agoHere's a justification for you: It's impossible to get a failure rate of 0, so there has to be a point where we get a satisfactory(for now) level of safety. Traffic kills so many people annually, that even a slight increase in safety is going to save more lives that are lost to aircraft accidents, radiotheraphy machine failure and such.
- gambiting 9y agoOf course, and I acknowledge that accidents will happen anyway. But we cannot have a car that is on the road with "autonomous" driving functionality when it is known that the sensors can't detect an obstacle above half-pillar height(like in that famous tesla crash), or that the lane detection can fail in intense sunlight(like dozens of videos on Youtube show). It should have no known failure states upon release, and then ones which are found should be fixed later. I'm just worried that we're in such a rush to release autonomous cars on the road that we are ignoring known issues for the sake of improving average safety on the road - literally no other industry works like this.
- adrianN 9y agoHow many other industries have such a high potential for saving lives by improving average safety? Traffic kills more than 80000 people every year in the EU.
- dsfyu404ed 9y agoWould you rather have a large chance of your car driving into something it couldn't detect and a slightly smaller chance of being seriously injured or the status quo? Keep in mind that the odds of being seriously injured in a car crash in one's lifetime are already fairly low. How many people do you know that were seriously injured in a vehicle crash? Most of the safety of AI comes from it being implemented in vehicles that are already far safer than average.
- adrianN 9y agoI'd rather have the solution with fewer serious accidents, even if it introduces types of accidents that don't happen with human drivers. I know a handful of people who were seriously injured in traffic.
- gambiting 9y agoI think accidents in traffic will be completely 100% solved by brake assist and collision prevention systems - I think they are meant to be mandatory in all new cars sold in US by 2020 if I remember correctly? So not long now. AI solves a different category of problems and isn't really necessary to solve crashes when there is a lot of cars driving close to each other.
- adrianN 9y agoI'm looking forward to those things as well. But bicycles don't have brake assist. It takes a very sophisticated collision detection system to prevent right-hooking a cyclist.
- michaelt 9y agoYou can't get to a failure rate of 0, but I can understand people wanting the car to drive at least as well as a human who was in, say, the top 5% of human drivers. Who'd want an autonomous car that's merely better than the _average_ driver, when every driver knows they're above average :)
- B1FF_PSUVM 9y agoOnce in a while the hot water tap will blow scalding steam on your hands, but the average temperature is nice. (Do you feel lucky?)
- rkangel 9y agoMy argument with your radiotherapy machine is that we're currently using the 'model that on average saves lives', and therefore anything we can replace it with that 'on average saves slightly _more_ lives' is an improvement.
- Strom 9y agoWhat you describe sounds like an irrational fear of machines, or perhaps fear of change? Let's take airbags as an example. Do you understand why airbags are allowed, or do you also find it obvious that airbags shouldn't be certified as safe to use? Airbags provide increased passenger safety on a statistical basis, as they mostly provide a cushion for impact. However there are plenty of edge cases where if you sit too close to an airbag, or let your small child sit next to an airbag, then that airbag will actually cause significant damage that wouldn't happen without the airbag. Autonomous driving can be viewed from the same safety perspective as airbags. Sure there are new edge cases that can cause harm, but on a statistical basis if the AI is even just slightly safer than a human, then at the end of the day there will be fewer accidents and fewer deaths. -- Your airplane example is a straw man argument. Nobody has claimed that we should stop advancing AI driving tech once we slightly surpass human skills. That's just the point where it makes sense to allow it on public roads.
- dsfyu404ed 9y agoIt's not about the number of edge cases, it's about the overall result. Airbags reduce variance in outcome. They hit a lot of people who would otherwise be unharmed in the fact with a small explosion in order to save a few lives in serious accidents. The worst case is better and the average case is better because you've eliminated some outliers. However,the median is far worse. The group is effectively being punished to reduce the effect of the worst performing members. An AI that drives into a partial lane obstruction is only better than no AI for a very small number of cases.