13 ms·
Tesla braces for its first trial involving Autopilot fatality
- baz00 3y ago> "There are no self-driving cars on the road today," the company said. Amazing that they charge for it then?
- malfist 3y agoLook, they only call it "Full self drive" you can't expect it to fully self drive the vehicle.
- brianwawok 3y ago[flagged]
- malfist 3y agoOh, I'm sorry, adding "capability" to the end of the phrase really changes its meaning.
- brianwawok 3y agoIt should? If you read at an 8th grade level or so.
- sodality2 3y agoTell me - if I sell a USB-C cable with "Data transfer capability" that does not transfer data at all upon sale. Is that fair?
- brianwawok 3y agoWhat does the paragraph of text on the order page say?
- InitialLastName 3y agoThey call it that because you have to drive it fully by yourself.
- brianwawok 3y ago[flagged]
- baz00 3y agoFuck what it says on the order page. They sell a car promoted as being full self driving capable at some point, yet have loads of different hardware revisions and sensor packages, none of which delivered it and they still have the audacity to charge people for being experimented on now and tell them that it's round the corner. This is a con. Stop being another damn apologist for people being ripped off.
- rwmj 3y agoIs it normal for these cases to take 4 years to reach trial?
- deleted 3y ago[deleted]
- rootusrootus 3y agoIf you have deep enough pockets and you're worried the verdict is going to be very expensive and probably not in your favor, there are lots of ways to stall the forward progress of the trial.
- rsynnott 3y agoNot abnormal. The J&J asbestos thing has been grinding on for, at least, a decade, say.
- sigmoid10 3y agoTesla self driving is only level 2 and they explicitly say that the driver must be fully attentive and have hands on the wheel at all times. So no matter how the courts rule here, it'll be about wording at best. A much more interesting case will come once Mercedes produces its inevitable first fatality with their level 3 system. Rather unlikely for now due to lots of factors (only works up to 40km/h, only on certain roads and much fewer cars sold), but this will set the stage for how far manufacturer liability actually goes for self driving.
- deleted 3y ago[deleted]
- Robotbeat 3y agoWhy is this comment downvoted? It’s pointing out correctly that the Mercedes system is the only one that allows you to take your hands off the wheel. Death is inevitable in literally any system, the point is to lower the death probability to well below human drivers.
- rootusrootus 3y ago> Why is this comment downvoted? Probably because the first sentence tries to say that 'full self driving' does not mean 'full self driving.'
- sigmoid10 3y ago...hence the whole case being about wording (i.e. marketing) that surrounds a feature, not the liabilities of actual self-driving.
- paxys 3y ago> So no matter how the courts rule here, it'll be about wording at best. That describes just about every civil court case in the world. The law is all about interpreting the meaning of words. Whether Tesla misled consumers into thinking their car could do more than it was capable of is a very important ruling, and will set a strong precedent for the entire self driving industry.
- mholt 3y agoIs this about Autopilot or Full Self Driving? The article is talking about accidents in 2019. But then it says: > Self-driving capability is central to Tesla’s financial future, according to Musk, whose own reputation as an engineering leader is being challenged with allegations by plaintiffs in one of two lawsuits that he personally leads the group behind technology that failed. Wins by Tesla could raise confidence and sales for the software, which costs up to $15,000 per vehicle. The $15k software is Full Self Driving, which is still in beta and has very clear customer warnings and consent screens before using. But the initial versions of this beta software wasn't even released for consumers until October 2020, a year after the crashes.
- baz00 3y agoThe context depends on if it's the PR and legal team talking or Musk's mouth flapping.
- AlexandrB 3y agoIs there a PR team? I thought Musk companies typically have Musk as sole PR.
- Spooky23 3y agoThe internet hive mind is the PR team. They’ll flood the zone with FUD better than any PR group because they aren’t accountable. It’s almost as bad as gun people arguing about gun minutiae. Was it autopilot? enhanced autopilot? Vaporware FSD that was sold but people didn’t realize does not exist? Real FSD that is in “beta”? Just like how reporting of some dude shooting up a nursery school will get derailed about mansplaining semi-automatic vs burst fire, anything Tesla must dissemble through the various bullshit.
- mcpackieh 3y ago(Gun laws deal in minutiae, so this is what you get in discussions concerning those laws.) You're basically correct.
- CamelCaseName 3y agoI hope Elon is personally held responsible for this death. It is crystal clear that Autopilot, Full Self Driving, and other marketing terms are deceptive and dangerous, yet led countless people to spend five figures each enriching the now wealthiest person.
- wahnfrieden 3y agoIt will result in a one-off tax on their operation
- tenpies 3y agoMusk-aside, I really want someone looking into what happened with the regulators. Yes, plural. From the FTC for allowing the marketing claims, to the NHTSA for allowing it on roads, plus whoever I may be missing. There has to have been some financial incentive for key regulatory personnel to look the other way so frequently. I don't mean Elon dropping off bags of cash, I mean something as simple as them having Tesla shares, but not being forced to disclose this or recuse themselves from any decision or case relating to Tesla.
- paxys 3y agoEven in the worst case the liability falls on Tesla, not Musk.
- Zetice 3y agoTeslas marketing has been in direct conflict with its capabilities, and hopefully they’ll get smacked down hard enough to stop being reckless with what they claim vs. what they disclaim later on. It’s called Full Self Driving. That matters, even if they clarify in the fine print.
- mholt 3y agoFSD wasn't released until the year after these crashes.
- shkkmo 3y agoTesla has been reckless with their self driving claims and safety for far longer than FSD has been available to the public. The suggestion here is that getting hit for those earlier reckless claims might hopefully get them to be less deceptive going forward.
- stetrain 3y agoThey've been taking money for a packaged called "Full Self Driving" since 2016.
- Ukv 3y agoThey've been taking money for cars with hardware capabilities to later become full-self driving, to my understanding. Could consider it taking money to pre-order FSD, but GP's point that it wasn't released yet is still relevant.
- stetrain 3y agoAll the cars produced have the same “FSD” hardware regardless of options selected. They are selling a software packaged called “Full Self Driving” that includes some current features, some “beta” features, and promises of additional functionality. Yes, Tesla has not yet released any non-beta feature that is really “Full Self Driving” but the marketing can be pretty muddled on what the car does today vs what it may do in the future.
- thebruce87m 3y ago> the Autopilot system caused owner Micah Lee’s Model 3 to suddenly veer off a highway east of Los Angeles at 65 miles per hour, strike a palm tree and burst into flames, all in the span of seconds. I only use Autopilot on motorways in the UK because I don’t trust it on single carriageways. Even on motorways roadworks can scar the carriageway in such a way that temporary lines are still visible after the works are visible. With the right lighting I definitely see things that would confuse a vision only system. Scary stuff. > The 2019 crash, which has not been previously reported, killed Lee and seriously injured his two passengers, including a then-8-year old boy who was disemboweled. This hit home really hard. My son is 7.
- boudin 3y agoHonest question, do you feel you can safely take back the control of the car when driving on a motorway if the "auto pilot" feature take a random decision you cannot predict?
- thebruce87m 3y agoYes, once you apply enough force to the steering it disengages. Annoyingly, to prove you are in control you must apply slight pressure on the steering wheel. I say annoyingly since it sometimes doesn’t register and you have to give more, which is counterintuitive if it is doing the right thing. On single carriageways this is worse since you are effectively trying to steer the car into oncoming traffic or off the road to prove that you are watching. That’s one more reason I don’t use it on these types of roads. All-in, it’s not really worth it tbh, and this is just the basic autopilot.
- matthewdgreen 3y agoYou can give it the same signal by moving the left volume knob up or down one click. It’s much safer than applying force to the wheel, which I agree is actively unsafe (the way Tesla handles it.)
- 3y ago
- sschueller 3y agoElon posted a 44 minute live video of self-driving. In it the car tries to run a red light in the most clear situation possible: https://twitter.com/RealDanODowd/status/1695268712910348471 https://twitter.com/RealDanODowd/status/1695268712910348471 The excuse is that this firmware version is not available to the public. Yet Elon is driving in public with other drivers putting everyone at risk of death. At what point are we going to stop this lunacy?
- mholt 3y ago[flagged]
- baz00 3y agoAh an idiot. Now lets mathematically multiply idiot by non-determinism and see what happens? A safety critical system is not safe if the outcome of the operator and the system is unpredictable.
- aaomidi 3y agoIve come across this behavior probably once, and I recall it happening in a situation where it “didn’t matter much”. Other than deliberate situations, no one is passing a red light in a busy intersection like that. Even drunk drivers aren’t going to be passing through that intersection while it’s red.
- chollida1 3y agoYes, people make mistakes and cause accidents. We have the legal system so an injured party can sue the driver if they are injured or disabled. In this trial, all they are asking for is that the auto pilot manufacturer be held to the same standard. You cause an accident by manually driving, you are legally liable. You release auto pilot software that causes an accident, you are legally liable. Everyone should be responsible for their actions. Seems like a very reasonable standard to hold everyone to.
- monkeywork 3y ago>You cause an accident by manually driving, you are legally liable. >You release auto pilot software that causes an accident, you are legally liable. The human behind the wheel should always be the one liable unless it can be shown that the human attempted to take corrective action and the system for some reason overrode the human or wouldn't allow the correction and "forced" the accident.
- fasteddie31003 3y agoAs someone who has FSD Beta, the improvements lately have been amazing. Driving my other non-FSD car is getting more and more annoying. If you extrapolate out the progress to around 5 years I see a world that has car insurance companies giving you a huge discount to use self driving. Maybe insurance companies will have a lower deductible while having a crash during self driving vs a high deductible during manual driving. I see FSD getting so good in 10 years the government would mandate it because it would eliminate a good portion of the 40k traffic deaths a year.
- wilde 3y agoI hope Tesla pays lots in damages and then keeps improving their systems. If they’re truly below the rate of human error when segmented by scenario there’s no reason for a ban. I also wish they’d knock it off with purposefully misleading marketing. They have a decent product but for whatever reason their CEO feels like compulsively lying about it.
- snapcaster 3y agoI'm not a lawyer and not well versed on the technical legal details of this, but it feels like if Tesla doesn't face some kind of consequences for marketing Full Self Driving but then saying "oh actually it's not if something bad happens" is so shameful and so bullshitty i'll be very discouraged
- dangus 3y agoSomething I’m not seeing yet in these comments is a discussion of the other automakers’ implementation of the same features. Nearly every other luxury automaker has an automatic steering and lane change feature as well. I think that other automakers will be hit with similar lawsuits regardless of what the driver assist system is called, because it will be easy to argue that the driver assistance systems assume some percentage of responsibility while active, and because you don’t have to win a lawsuit to reach a favorable settlement. Tesla may pay out more than other automakers due to its optimistic marketing.
- redox99 3y ago> Something I’m not seeing yet in these comments is a discussion of the other automakers’ implementation of the same features. Because these threads always become Tesla hate instead of an objective analysis. All of these lane centering ADAS (including Autopilot) will kill you if you leave them unattended long enough (usually by taking a tight off-ramp at an unsafe speed). These is very evident to people who actually use these systems. And there's nothing wrong with such behavior, it's an L2 system. Cruise Control will also kill you. These systems have been on the road for a long while and people aren't dying left and right because of it, they are empirically reasonably safe. They're probably a net positive as they likely drastically reduce rear ends. People just get riled up at one off accidents because they make the news.
- r00fus 3y ago"Safe" isn't a binary. They could be extremely risky to use in specific known or unknown use-cases.
- onlyrealcuzzo 3y ago> Nearly every other luxury automaker has an automatic steering and lane change feature as well. Are they calling smart cruise control "Full self driving" and "Autopilot"? Smart cruise control has existed for a while now, and it is not regularly veering off course and slamming into palm trees & fire trucks. Full self driving Teslas - according to Tesla - do not actually exist - and yet they sell & market them and have the outcomes that they do. And then they have the balls to lie and say the system wasn't engaged - and tell everyone to keep using Full Self Driving Autopilot as normal.
- mrkeen 3y agoI think the following excerpts make a nice juxtaposition: > the Autopilot system caused owner Micah Lee’s Model 3 to suddenly veer off a highway east of Los Angeles at 65 miles per hour, strike a palm tree and burst into flames, all in the span of seconds. The 2019 crash, which has not been previously reported, killed Lee and seriously injured his two passengers, including a then-8-year old boy who was disemboweled. > Wins by Tesla could raise confidence and sales for the software, which costs up to $15,000 per vehicle.
- frob 3y agoA new car built by my company leaves somewhere traveling at 60 mph. The FSD confuses a firetruck for an empty lane and drive full-speed into the back of it. The car crashes and burns with everyone trapped inside. Now, should we stop taking money for FSD? Take the number of vehicles in the field, A, multiply by the probable rate of failure, B, multiply by the average out-of-court settlement, C. A times B times C equals X. If X is less than the windfall we get for selling people something called "Full Self-Driving" that isn’t actually self-driving, we keep taking money for it.
- mrkeen 3y agoI don't dispute the calculus there, but that's not quite what I read in the passage from the article. In this case it's the consumer that's made to look ridiculous:- You can buy the car and get wrapped around a tree. But if the courts don't think Musk should pay you damages for that, then somehow you're more likely to buy the car.
- SpicyLemonZest 3y agoWell, another important piece of the puzzle is > the company has argued that Lee consumed alcohol before getting behind the wheel and that it is not clear whether Autopilot was on at the time of crash. Given that this case hasn’t been previously reported, I don’t think anyone can claim to know that Tesla’s version of the story is false. Presumably if they’re confident in it, Tesla won’t agree to a last minute settlement, and we’ll see what evidence comes out in the trial.
- 3y ago
- miroljub 3y agoSelf-driving cars are just a dream. It will just not happen as long as self-driving cars and humans share the same roads. AI will never be better at avoiding a playing child who accidentally stepped on the road as an average human driver. If we want self-driving cars to become a reality, we should instead make separate roads, and let the drive there. Some analogue to railroads, that are used exclusively by trains.
- myrmidon 3y ago> AI will never be better at avoiding a playing child who accidentally stepped on the road as an average human driver. What makes you so confident? I'd argue for the reverse-- there is absolutely no way that humans are able to compete long term, because human reaction time and focus/attention is inherently limited-- as soon as computer vision starts to outperform, humans will NEVER become competitively safe drivers again (could be 5 years, could be 50, who knows, but this seems EXCLUSIVELY a matter of time, especially considering the progress we made in the last decades).
- miroljub 3y agoYou misunderstood my point. I'm not saying that humans are always "better", just that humans are better in mixed environment. In controlled roads without humans, AI can be clearly better even today.
- myrmidon 3y agoI don't see how the mixedness of the environment changes anything; sure, a mixed-driver environment is more difficult to navigate because traffic participants are less predictable, but this effectively just delayes the point slightly at which AI will simply outperform even the best humans, right?
- Closi 3y ago> AI will never be better at avoiding a playing child who accidentally stepped on the road as an average human driver. Very hard to predict what will be possible with AI in 10 years time, but I wouldn’t bet on humans here. Humans have a number of disadvantages compared to an AI agent in this scenario - they look at phones, get tired, technically have slower response times… And then AI has seen tremendous advancement in the last 3 years with it basically smashing a load of tasks that were thought to be entirely ‘non-automatable’ by many people. Plus think about what has been achieved in the self driving space in the last 10 years and then imagine what can be done in the next 20. It’s probably not a 1-2 year thing (imo), it’s probably a 10-20 year thing (but again totally unpredictable! Maybe 5 maybe 50!). And self-driving without operating cooperating alongside human drivers just won’t happen from an infrastructure perspective.
- frob 3y ago> "There are no self-driving cars on the road today," the company said. Says the company that makes a product literally called "Full Self-Driving." What a bunch of fucking lowlife charlatans. I surprised they didn't sign it with a smiling poop emoji.
- throw7 3y agoUntil liability is on the manufacturer, I'm really not interested in self-driving cars. Currently, when you use "self-driving", you need to pay more attention not less, because the system adds an additional unpredictability calculation to your driving, that you wouldn't have if you were just driving in the first place. Don't get me wrong, I'd love to have a car I could tell to go the shop and get serviced. Or come to the airport to pick me up. Do I think that could happen? Maybe sooner with infrastructure support (but that'll be expensive), so realistically I'm pessimistic.
- neilv 3y ago> The 2019 crash, which has not been previously reported, killed Lee and seriously injured his two passengers, including a then-8-year old boy who was disemboweled. The lawsuit, filed against Tesla by the passengers and Lee's estate, accuses Tesla of knowing that Autopilot and other safety systems were defective when it sold the car. Do we know anything about the likelihood of criminal charges over that crash?
- dopamean 3y agoThis may be a slightly weird thing to say and maybe I wont put it very eloquently but I'm somewhat of a believer in taking risks that can endanger lives now if it means doing something that is a net positive for everyone later. I'm not great historian but I think the aviation industry is a good example of this. Basically every plane crash that resulted in passengers dying has led to changes, and very often improvements, in air safety. Whether that be a change in the mechanical, software, or human systems that govern aviation. Globally these things are taken quite seriously because everyone understands how important it is. So it's odd to me to see such cavalier attitudes taken when it comes to self driving cars. Why not take safety more seriously? It will earn the industry a ton of trust and it could save lives.
- kayodelycaon 3y ago> Why not take safety more seriously? Because safety is a cost, not a feature. Air travel and sea travel did not get safer because some companies got together and decided to spend a little money to advance society. Ships sank and planes crashed frequently. Things got safer because governments took action. Look at the 737 MAX. The cause of the crashes wouldn't have been investigated and Boeing wouldn't have fixed their plane if governments hadn't taken action. At scale, companies do not value human life, so regulations add costs to change the incentives. Otherwise human life is just another tragedy of the commons.
- dopamean 3y agoI don't think that's a totally fair characterization of the history of air safety but I do mostly agree with your point. Government has to take action and right now they're just permitting anything... or that's what it looks like.
- specialist 3y agoNiedermeyer makes some interesting points about Tesla's FSD. "Why urbanists are wrong about autonomous vehicles w/ Tesla critic Ed Niedermeyer" 2023-08-17 https://micromobility.io/news/why-urbanists-are-wrong-about-autonomous-vehicles-w-tesla-critic-ed-niedermeyer https://micromobility.io/news/why-urbanists-are-wrong-about-... TLDR: Equating autonomous vehicles (AVs) with Tesla's FSD is a category error. Tesla's FSD is a fraud.
- AndrewKemendo 3y agoAt this point we have a car company that puts out poor fit and finish quality vehicles, with terrible customer service, maximum data collection, and now arguably lethal $10k upgrades? Why is this the future? Can we make it not the future? If the benefit of switching to electric is that high and the bar seemingly low (given the above), then shouldn’t we be seeing way more fully electric vehicle companies and models?
- chemmail 3y agoThis article goes back and forth from Autopilot and Self driving. Which are totally different systems. I cannot even read this article.