8 ms·
There's no evidence that computers are any better at driving than humans, and there is no evidence that this generation of machine learning will be able to tack
by heavyset_go 7y ago
There's no evidence that computers are any better at driving than humans, and there is no evidence that this generation of machine learning will be able to tackle this problem sufficiently. All signs point to driving requiring an understanding of what's going on around you, which this generation of ML does not provide.
On the other hand, there is a lot of hype and promises being made without the results to back them up.
- daniel_iversen 7y agoIsn’t there already a mounting amount of statistics of accidents of self driving cars vs manual ones and the difference is night and day that the self driving ones are statistically safer?
- occamrazor 7y agoSelf driving cars killed one pedestrian in 10 million miles driven, about an order of magnitude worse than humans
- seltzered_ 7y agoIs that data on self driving cars or assisted driving? I think disengagement statistics also need to be factored in.
- blattimwind 7y agoThat's the Uber "Level 3" accident.
- NobodyNada 7y agoBut that’s a sample size of one, so we can’t really draw any meaningful conclusions from that data. (Also the safety driver was watching Netflix on her phone; it could be argued that the vehicle was not production-ready and not expected or intended to be able to handle every situation.)
- scrozier 7y agoI'm not sure that sample size is a relevant idea here, but it's certainly misleading as you state it. One accident in many billions of miles would be a wonderful result, but you would dismiss it as a sample size of one.
- slavik81 7y agoLet's say everyone replaced their current cars with self-driving vehicles and they never killed anyone ever again. If normal vehicle usage continued and fifty years passed without a single traffic death, your claim suggests we'd still be unable to say if self-driving cars were safer, as it would still be a sample size of one. I don't think your use of statistics is correct.
- cultus 7y agoNot at all. Self-driving cars cannot yet safely navigate complex or unusual scenarios. The human backups in test cars still have to take over with good regularity. That's not something you'd see if it were anywhere close to ready. Even with all their data, there aren't enough training examples of every situation. Deep learning models also have a tendency to be pathologically wrong in rare but completely unpredictable circumstances. Tesla's self driving has resulted in cars swerving into gore points, for example.
- the8472 7y ago> Not at all. Self-driving cars cannot yet safely navigate complex or unusual scenarios. That's assuming accidents are caused by complex and unusual scenarios instead of humans being inattentive during routine tasks. If machines fail at complex tasks but fail safely then that's not an argument against self-driving cars being safe, it's only one about their limited usefulness.
- blattimwind 7y ago> If machines fail at complex tasks but fail safely then that's not an argument against self-driving cars being safe, it's only one about their limited usefulness. They don't, not at the moment. The software detects the situation is outside its capability space and says "jesus, take the wheel!". For all practical intents and purposes the only reasonable way to interpret the current self-driving car statistics is to treat every single human intervention as a would-be accident. That rate is somewhere in the 1 per 10000 km ballpark. That's - for now - orders of magnitudes worse than human drivers.
- slg 7y agoNo. There is not yet enough data to say that Tesla's or anyone else's current technology is better than human drivers. You likely need tens or hundreds of billions of miles to prove that. However since accidents are a very low probability event, it would take substantially less data to prove that this technology is drastically less safe than human drivers and that hasn't shown itself in the data either. Either side that points to specific numbers as proof either doesn't understand the statistics or is intentionally trying to mislead you.
- ogre_codes 7y agoThe problem is the datasets are incompatible. Tesla's numbers are very impressive until you realize that it will currently only engage in scenarios which are less prone to accidents across the board. As the number of situations where self-driving kicks in increases to include more complex environments, it's likely the numbers will shift.
- xiphias2 7y agoEven though the numbers will shift, Tesla can't afford to have worse statistics than with human drivers. That's why it takes years to enable city level (L2 and maybe L3 in rush hours) driving. At the same time it really looks like Tesla will enable it this year, as Elon's predicted timelines are getting shorter.
- the8472 7y ago> There's no evidence that computers are any better at driving than humans That's a vacuous statement. Evidence would be a deployed self-driving fleet. At which point it would be mission accomplished and we wouldn't be discussing this. Now if you want theoretical considerations instead of evidence, then consider the lower reaction times of machines.
- donkeyd 7y ago> then consider the lower reaction times of machines Meanwhile, Teslas run into the backs of car carriers because they only recognise the car it's carrying and not the truck bed extending behind it. It might react faster, but it needs to identify the danger first and up until now, it's much worse at that in many situations. Yes, you're right, once it's safer, it's safer. That makes your statements just as vacuous as theirs.
- deleted 7y ago[deleted]
- cortesoft 7y ago> Meanwhile, Teslas run into the backs of car carriers because they only recognise the car it's carrying and not the truck bed extending behind it And someone rear ended me the other day because they didn't notice cars were stopping. Yes, self-driving cars make mistakes, but humans make all sorts of mistakes, too. The question is, do self driving cars have more accidents per mile (or more damage per mile/injuries per mile/ deaths per mile) than human driven cars?
- henrikschroder 7y ago> The question is, do self driving cars have more accidents per mile (or more damage per mile/injuries per mile/ deaths per mile) than human driven cars? It should matter if they have less, but in the real world it doesn't matter, because it's "scary" to be rear-ended by an unthinking machine, and business as usual to be rear-ended by a clumsy human, so people will always hold machines to a much higher standard.
- meerita 7y agoHow would you compare both? Computers can process millions of objects and things all at the same time, with a error margin than any human being would love to have.
- gamblor956 7y agoIt doesn't matter how many objects a system can process if it can't recognize what they are or which ones are actually important, like say, the truck crossing in front of you.
- bdamm 7y agoThey don't need to recognize what objects are as much as they need to compute the expected and predicted paths of those objects.
- meerita 7y agoHumans can have "visions" or can mistake shapes and interpret as things, our brain is easily hacked.
- blattimwind 7y agoYet a human tends to notice that their perception is unreliable and can react accordingly.
- meerita 7y agoaccordingly in the middle of the road?
- andreilys 7y agoWhat about computers being safer drivers than humans who are texting and driving?
- pcurve 7y ago"All signs point to driving requiring an understanding of what's going on around you, which this generation of ML does not provide." That may be very true, but are most of us fully present in the act of driving ? Where the ML is deficient we can make up for it by making the infrastructure more robust.
- mrmonkeyman 7y agoSpeed of computation cannot overcome lack of cognition.
- donkeyd 7y ago> making the infrastructure more robust Can't make human behaviour inside that infrastructure more robust though. So we'd need to completely split human and autonomous traffic. That'll be about as big a challenge as creating the autonomous cars in the first place. My guess is at least 15 years before we'll see any large scale adoption of autonomous vehicles. And that's for countries like the Netherlands which are already pretty well organised. Countries with chaotic driving styles and roads like Italy will take longer and the third world might take decades longer because of the lack of rules in many of those countries.
- adrr 7y agoWaymo ordered 60,000 mini vans and 20k suvs. They are running full self driving in Arizona without safety drivers. Self driving is already here. Waymo just started petitioning California for the ability to start charging. I bet we see sf go live with Waymo taxis at the start of 2021.
- jaimex2 7y agoSearching "dash cams" on Youtube says otherwise.
- scarejunba 7y agoThere is some evidence. For instance, Tesla drivers report the car stopping before they can perceive an accident about to take place. An example is the first ten seconds of this video https://www.youtube.com/watch?v=APnN2mClkmk https://www.youtube.com/watch?v=APnN2mClkmk These vehicles have a superior sensor system to us. Our processing is better but sometimes their superior sensors are better.
- Ntrails 7y agoSure, and as soon as I can sit facing the other way and not be responsible for the cars fuck ups that's fine. Until then semi autonomy can fuck right off. I'd rather trust myself 100% of the time than a machine 99% of the time.
- anchpop 7y agoSure, that's your decision. I'd rather have the car and I work together to prevent accidents, or let the car take over at low speeds
- Ntrails 7y ago> or let the car take over at low speeds Except arguably that's when the car is least effective! That is when pedestrians walk out or vans reverse with the wrong kind of shiny paintwork. Reaction time is less important at low speeds vs effective and accurate processing. Actively driving results in my attention being engaged, all the time. Passively letting the car drive will 100% reduce my engagement, and when the car fails I will not notice. And sure, for now it's my decision, until it becomes mandatory on new cars alongside automatic breaking etc...
- stefan_ 7y agoHere are the superior sensors steering the car straight into a paper box: https://twitter.com/greentheonly/status/1202778123433119745 https://twitter.com/greentheonly/status/1202778123433119745 It's even fricking speeding up!
- bitL 7y ago> computers are any better at driving than humans Does it matter though? If it drives like my grandma, I can still do other things while in a car and hate commuting/traffic jams a bit less.
- brokenmachine 7y agoThe problem is that all these so-called "self-driving" systems expect you to be alert and ready because at any moment they might decide that the human needs to be in control again. So you can't do other things while in the car.
- bitL 7y agoThat's right now and that's why companies have to provide level 5 autonomy or there won't be any customers. Yet for days with good weather in urban environments level 5 might come within a decade; it's still better to be able to drive only half of the time instead of all the time. The long tail of problems that is supposedly plaguing self-driving systems exists with humans as well - how would you react if a bridge/building in front of you started collapsing or somebody started overtaking right in front of you?
- brokenmachine 7y agoI'd hit the brakes. But then again, I am actually able to discern what is a bridge and what isn't, and thus don't have the need to suddenly cover my eyes and scream, "I'm confused and I don't want to drive anymore!"
- grey-area 7y ago> There's no evidence that computers are any better at driving than humans Yes, there is. You can debate the exact figures/circumstances, but the numbers are good, and improving all the time. Humans are just not very good at guiding tons of metal around at high speeds, which isn't very surprising when you think about it. One accident for every 4.34 million miles is already pretty good (compared to 500k miles for humans) - if it were rolled out today across all cars it would probably save thousands of lives in the US. Yes these quarterly numbers are in the best conditions and supervised, no that doesn't invalidate them, particularly as they show dramatic improvement at the same time as they keep expanding the conditions in which autopilot functions. There will always be a long tail, but computers are getting very close to good enough for highway driving, known truck routes, and known taxi routes. https://electrek.co/2019/10/23/tesla-autopilot-safety-9x-safer-than-average-driving/ https://electrek.co/2019/10/23/tesla-autopilot-safety-9x-saf... https://www.tesla.com/VehicleSafetyReport?redirect=no https://www.tesla.com/VehicleSafetyReport?redirect=no
- Slartie 7y ago> Yes these quarterly numbers are in the best conditions and supervised, no that doesn't invalidate them... That is exactly what it does: it invalidates them. Comparing apples to oranges is an invalid comparison. Let's compare the numbers again when there's sufficient data for self-driving tech driving in all environmental conditions without supervision and without human assistance jumping in whenever it gets rough. At that point, a comparison is valid. Until then you're comparing someone who aces tests with someone who is just doing good, but the first guy is only solving first-graders' multiple-choice tests and cheats by asking a friend who graduated at a university whenever a question pops up that isn't "choose one of these three", while the second guy is on his own in the middle of his college education.
- grey-area 7y agoAre computers better than the best human drivers in all circumstances? No, maybe they never will be, but that doesn't matter. Are they better than average humans in average conditions already? Yes. They don't need to be all powerful AGI which can replace humans in all circumstances to be useful and save lives.
- grecy 7y ago> There's no evidence that computers are any better at driving than humans People said that about computers when it came to basic computations. They said it about computers when it came to landing on the moon. They said it about computers when it came to electronic tax returns, digital currencies, music, movies, video games and everything else in the history of the world that computers once couldn't do, but now do with ease, and much much more accurately and faster than the old way of doing whatever it is. With sub-millisecond reaction times and eight cameras and radar instead of only two eyes, it's blatantly obvious computers will be better drivers than humans. It's just a question of when.