47 ms·
I would be a lot more forgiving of these screwups if Tesla didn't constantly swear up and down that they've solved self-driving cars. As far back as 2016 they
by SilasX 8y ago
I would be a lot more forgiving of these screwups if Tesla didn't constantly swear up and down that they've solved self-driving cars.
As far back as 2016 they were claiming they had full SDC capability above human driver safety [1], and their recent Model Y announcement suggests that the only thing holding it up is regulatory approval, and not failure to achieve the desired spec.
>Model Y will have Full Self-Driving capability, enabling automatic driving on city streets and highways pending regulatory approval, as well as the ability to come find you anywhere in a parking lot.
[1] https://www.tesla.com/blog/all-tesla-cars-being-produced-now-have-full-self-driving-hardware https://www.tesla.com/blog/all-tesla-cars-being-produced-now...
[2] https://news.ycombinator.com/item?id=19397942 https://news.ycombinator.com/item?id=19397942 (linking HN because it's hard to find the text in the page with their UI)
- Scoundreller 8y ago> As far back as 2016 they were claiming they had full SDC capability above human driver safety One crash/incident doesn’t mean it’s less safe than a human driver on average, even if it’s something a human driver might have avoided. We should expect different failure modes from a machine, but adopt it anyway if it avoids enough human failure modes to make up for it. Source: my thermostat thought 33C was an acceptable temp once, but I still didn’t switch to full-manual HVAC control.
- tptacek 8y agoDon't Teslas fare significantly worse than cars in similar class in terms of driver fatalities?
- lordalch 8y agoI don't have the fatalities stats, but their safety ratings have been perfect. [0] https://www.cnbc.com/2018/09/20/tesla-model-3-earns-perfect-5-star-nhtsa-safety-rating.html https://www.cnbc.com/2018/09/20/tesla-model-3-earns-perfect-...
- Scoundreller 8y agoDunno, maybe. I do wonder which cars Tesla gets lumped in with. There can be a difference between a $75k ICE driver and a $75k electric driver. The point is, one stupid decision by a machine doesn’t prove much.
- salawat 8y agoSo... Two planes falling out of the sky, killing 400 shouldn't be taken as proving anything? Or how about 1 stupid decision by a radiotherapy machine? Ever heard of THERAC-25? In each case, it was just 1 stupid decision by a machine. The entire reason Engineering as a practice is a thing is because when you implement the capacity for a stupid decision into a system that is then mass produced, dire consequences can result. I look down on any thought process that doesn't discriminate between the difference between 0 and 1. If the system provably worked, that decision would not have happened (0). The stupid decision happened (1), however, which means it can happen again at a poorly understood confluence of circumstances. To err is human, and we forgive each other every day for it. To err as a machine is a condemnation to the refuse bucket, repair shop, or back to the drawing board. To err so egregiously as a machine to cause an operator and those around them to lose their life is willful and moral negligence on the part of the system's designer. Slack is cut when good faith is demonstrated, but liability is unambiguous. The hazard would not be there if you hadn't put it there.
- Scoundreller 8y agoAnd people have died and been paralyzed as a direct result of the flu vaccine. Death and paralyses that would not have occurred had they not received that vaccine. Does that mean the flu vaccine should get dumped in the refuse bin? Similarly, some other aircraft flying today/tomorrow has automation with an unknown bug/issue that will cause loss of life. Should we disable everything except the 6-pack and stick and rudder? It would have saved the lives killed by automation, but we would have more aviation death overall.
- perl4ever 8y agoDoes that mean you believe the decision to ground 737 max 8s is incorrect?
- slg 8y agoAre you asking about Teslas or Teslas being driven by Autopilot? Autopilot so far has a fatality rate of roughly 0.25 per 100 million miles. Just for information's sake the overall rate in the US in 2017 was 1.16 per 100 million miles. Although there are plenty of caveats that should prevent you from comparing those numbers directly. The national number is for all cars, all drivers, all conditions, etc while those driving a Tesla in Autopilot are generally considered to be in a safer cars, safer conditions, and be safer drivers than average.
- FireBeyond 8y agoTesla drivers have the luxury of turning autopilot off in suboptimal conditions. Human drivers don't. Like you say, this number is really valuable only for Tesla marketing.
- heavenlyblue 8y agoTesla would have had 0 fatalities in total if the Autopilot disengaged just before hitting the barrier.
- SilasX 8y agoFor all driving protocols P, and accidents A, P would have zero fatalities if it switched to a better protocol just before encountering the situation that led to A.
- heavenlyblue 8y agoThat's exactly what I am trying to say. Yet Tesla implies their tech is statistically superior to human drivers, yet can disengage at any time.
- SilasX 8y agoAh okay. Sorry, easy to misread people on this topic.
- slg 8y agoI don't want to dismiss your whole point, because it is certainly valid, but that isn't really the issue here. It is entirely possible for bugs like this to exist in the self driving tech and for Tesla to be correct in their claims that Autopilot is on average safer than a human driver. It is obviously troubling to see self driving cars run into solid and stationary objects, but human drivers do that all the time too. The question shouldn't be whether this technology is perfect, it should be whether this technology is safer than humans. You and I certainly don't have enough data to say one way or another on that. I would bet even Tesla doesn't have enough data to say definitively. However writing this tech off as unsafe just because it makes what seems like an obvious mistake is a great way to slow progress which will result in more human deaths long term.
- ketzo 8y agoThat’s one of those thorny AI-human problems, though — if I crash 1 in 10 drives, it’s my fault, and therefore much easier to rationalize to be, well, not my fault. If my Tesla crashes 1 in 100 drives, it’s a faulty machine and an obvious death trap.
- slg 8y agoIt is a classic trolley problem. Is it worth killing a group of innocent people if it will save a larger group of innocent people? I can certainly see why people might be pushing for caution against Tesla since we don't know the size of either of those groups.
- tim333 8y agoIt could theoretically be a trolley problem. In practice Tesla are probably not that safe if you compare them driving themselves on freeways to humans driving under the same conditions.
- btilly 8y agoI was going to point you to a study showing that autosteer reduced accidents by 40%, but Google told me that this was recently shown to be wrong. In fact it increased accidents by 60%. See https://arstechnica.com/cars/2019/02/in-2017-the-feds-said-tesla-autopilot-cut-crashes-40-that-was-bogus/ https://arstechnica.com/cars/2019/02/in-2017-the-feds-said-t... for details and verification.
- Animats 8y agoModel Y will have Full Self-Driving capability, enabling automatic driving on city streets and highways pending regulatory approval, as well as the ability to come find you anywhere in a parking lot. We've heard that before, for the Model X.
- pbreit 8y agoThe passage says “will” which implies the future.
- bitL 8y agoThey solved it, they just need 100x faster GPUs in cars to be reliable outside datacenters ;-)