8 ms·
How Safe Is Tesla Autopilot?
- codingdave 10y agoThe naming of Autopilot is unfortunate, because it is not one... but that name may give drivers an inclination to trust it more than they should.
- vkou 10y agoCatching a cold is unfortunate. Naming a much-hyped feature of your multi-billion dollar company's only product - in such a way that causes confusion about its capabilities is not unfortunate. It is deliberate.
- bdrool 10y agoThey should have called it "Cruise Control Plus™" or something similar. Regardless of the usual arguments about how accurate the name is according to the avionics definition of the term, "autopilot" is misleading in the context of the consumer car market. Tesla should not have named it that.
- deckar01 10y ago> autopilot: a device that steers a ship, aircraft, or spacecraft in place of a person. http://www.merriam-webster.com/dictionary/autopilot http://www.merriam-webster.com/dictionary/autopilot I am surprised that Merriam Webster's definition only mentions steering and not acceleration. Telsa's autopilot does have a steering component, so it doesn't seem to be that much of a stretch.
- Blaaguuu 10y agoI think the argument against the term 'autopilot' is less about the technical accuracy, and more about the implication and assumptions of the layman. To most people, 'autopilot' suggest that they can be totally hands-off, which isn't true yet.
- FireBeyond 10y agoYeah, I feel like the people here/elsewhere who take great pains to point out the limitations of aircraft autopilot systems somewhat miss the point - the general perception of what is offered. The average lay person doesn't care about different axes of autopilot, Flight Management Systems (FMS), Inertial Navigation Systems (INS) versus GPS, autloand capabilities and categories of Instrument Land Systems (ILS). (Yes, I grouped several different, complementary technologies together, whilst aware of their definitions, to further my point). Lay understanding of autopilot being 'tell it a destination, let it do the work'.
- jws 10y agoReally? The autopilot on my boat will attempt (badly) to go in a straight line, care nothing about speed, and will happily run me into buoys, boats, beaches, bridges, and boulders. If you are foolish enough to attempt to provide a route with waypoints for turns it will throw the rudder over without warning so suddenly that you may be injured or thrown from the vessel. It's a big world, I suppose there are people that think "autopilot" means "crawl into the back seat and take a nap", but there is certainly a spectrum, and if you try to name something so it can never be misunderstood you will probably end up calling it "NaviaMODE™®℠" and then no one knows anything.
- jedmeyers 10y agoI don't think the average consumer will think about boat 'autopilot' when he hears the term. For most people autopilots are associated with airplanes, because that's where there are actual pilots, not drivers or helmsmen.
- jws 10y agoIn the English language, a "pilot" has meant "one who steers a ship" for almost 500 years. In 1848 it got used for balloonists, in 1907 it got used for airplane steering people.
- jedmeyers 10y agoI doubt there are a lot of people currently alive who associate the 'pilot' term with maritime activities, unless it's explicitly stated.
- trackofalljades 10y agoI think maybe you don't understand what autopilot actually does on a plane...but regardless I agree it was a dumb name that made sense to engineers but should have been shot down immediately by marketing and legal.
- mhneu 10y ago? This name has certainly been HIGHLY vetted by both marketing and legal. I would wager that the name "Autopilot" was created by marketing, not engineering.
- danielsju6 10y agoAm I missing something with this argument? It's consistently made on these anti-Tesla threads here and on Reddit, but from my understanding an aircraft's autopilot is actually dumber than Tesla's. You set bearing, altitude, and speed and the plane will adjust to and keep that course—that's it. Some will land in optimal conditions, but they're unable to taxi. Also a great deal of plane crashes are due to "handoff" issues. So it seems to me that Tesla's auto-pilot is aptly named.
- detaro 10y ago> You set bearing, altitude, and speed and the plane will adjust to and keep that course—that's it. And that's a very useful and safe way to get a plane from A to B, given the amount of route planning and air traffic control in modern aviation. An autopilot can generally provide ample warning of situations it can't handle, and a plane at cruise altitude has quite a bit of room for recoverable error. Until we have traffic control on our highways that makes sure our cars know about obstacles early enough, the same basic features are not enough to provide the same experience for a car.
- ChicagoBoy11 10y agoThe problem with the naming has nothing to do with the technical capabilities, but an understanding of how that will impact human-machine interaction. You are absolutely right that aircraft autopilot is a lot "dumber" in a sense. But there is no ambiguity in the fact that when the pilot turns on the autopilot, he can -- and does expect -- the computer to take over all flight operations. By naming the system autopilot, Tesla has also created that same expectation with their customers. Not only that, but it has at best turned a blind eye to reports and videos and stories of customers who willfully take their hands of the wheel/sit in the back seat/etc. and at worst encouraged an erroneous public perception of how the autopilot system should be used. The issues you cited in handoffs with airplanes are far more complicated when it comes to cars, where decisions need necessarily to be taken in a much shorter period of time. But all of that seems really downplayed by Tesla marketing, which instead chooses to aggressively market just how close the system is to full driving autonomy, instead of more like a gentle aid to monotonous highway driving. The disconnect between their official documentation and their marketing is immense. That is what is potentially dangerous.
- g52oevr0in 10y agoWhat we learn is: Autopilot is a very clear name for the commenters in this thread. These commenters understand that an autopilot does not replace a driver. Apparently, it's not such a clear name for other commenters on the same post, and the company called Tesla, who argue that autopilot is safer than a driver.
- J-dawg 10y agoPutting aside the semantics of the word "autopilot", haven't Tesla always been clear that the system was in beta and should only be used by a fully attentive driver, with your hands held close to the steering wheel? This understanding only comes from watching autopilot videos on YouTube. I've never seen the official instructions sent to owners, so I could be wrong. If this is the case, it seems unfair to blame Tesla for incidents where people have used the autopilot in direct contravention of the instructions, just because we all slightly disagree on what the name means. Can any Tesla owners comment on what information was sent to them when autopilot was rolled out?
- deleted 10y ago[deleted]
- mrfusion 10y agoI vote for calling it "toddler has the wheel!" (Tm) Because that's exactly how you should treat it.
- Tharkun 10y agoThe article is a good summary of Statistics 101.
- trackofalljades 10y agoTLDR for every piece written about this, it's still safer than a human driving alone, period. When used properly, it's vastly safer, and when used improperly, it's probably still safer but only just...the thing to consider is the kind of driver who's selfish and dumb enough to misuse this kind of thing is a high risk driver without it and would probably still be worse.
- wiremine 10y agoNot disagreeing, but is there any hard, independent third-party research to back up this claim? As an engineer, I tend to lean this way. As a father of two, I want to see some numbers to back up statements like "still safer than a human driving alone, period."
- jfoutz 10y agoHard to find current statistics. This [1] seems pretty believable. Not sure if it's "good" or not, but there you go. It's interesting that, just eyeballing it, mass seems to be the dominating factor. The crown vic is discontinued, but was fairly inexpensive, looks like it was originally $25-30,000. Compared to a C Class, $30-35,000, which had more fatalities. Of course, this is all 5 years old, so maybe there are better safety features available now. There are a couple of things that may or may not be believable. Maybe it's possible for one or a few drivers to greatly improve the global traffic system [2]. I believe it, but i can't find a real study that proves it. I do think a handful of self driving cars can smooth out those compression waves, just by driving sanely. Finally, purely anecdotally, a friend of mine is a truck driver. We get to catch up over dinner every few months. He sees people doing crazy things multiple times a day. He sees the helicopter ambulances on a weekly basis, passing by wrecks in either direction. His assertion, if people would just stay calm and consistent, a lot fewer people would die. It's either someone not paying attention, or being super aggressive. I, also, would like to see a study. I would bet quite a bit of money, that a highway with only autopilot drivers would have zero wrecks. I guess the real question is, does sensor failure (device failure, snow, things like that) dominate wrecks? or is it interaction with unpredictable (aggressive, inattentive) drivers? [1] (pdf) http://www.cbsnews.com/htdocs/pdf/Driver_DeathRates_sr5001_emb.pdf http://www.cbsnews.com/htdocs/pdf/Driver_DeathRates_sr5001_e... [2] http://trafficwaves.org/ http://trafficwaves.org/
- gnicholas 10y agoGood background on statistics and sample size. Also relevant is the fact that Teslas are (1) heavier than the average car, (2) newer than the average car in America, and (3) more expensive than the average car. All of these factors are not only correlates of—but actually cause—better vehicle safety outcomes. For more detailed numbers, see http://www.thedailybeast.com/articles/2016/07/14/why-tesla-s-cars-and-autopilot-aren-t-as-safe-as-elon-musk-claims.html http://www.thedailybeast.com/articles/2016/07/14/why-tesla-s... (disclaimer: I am one of the co-authors).
- vkou 10y ago> One Tesla owner describes this Catch-22, after being told that a crash was her fault because she turned off Autopilot by hitting the brakes: “So if you don’t brake, it’s your fault because you weren’t paying attention,” she told The Wall Street Journal. “And if you do brake, it’s your fault because you were driving.” If this is true, this is a fairly damning statement about the reliability of autopilot - it calls any statistical claims Tesla provides into question.
- J-dawg 10y agoThe "Catch-22" doesn't make a lot of sense, really. In either case you are driving. Until we legally recognise autopilots as being fully in control of the car, the driver is always driving. Her statement does make me wonder how relaxing it would really be to drive a car with autopilot, though. If I can't sit back and trust it 100%, I think I'd rather just be fully engaged in driving the car.
- gnicholas 10y agoYou're not alone—humans are not very good at constantly monitoring systems, which is essentially what are asked to do in the early days of "autopilot": http://www.csmonitor.com/Business/In-Gear/2016/0827/NASA-thinks-Tesla-Autopilot-is-a-bad-idea http://www.csmonitor.com/Business/In-Gear/2016/0827/NASA-thi...
- 10y ago
- ChicagoBoy11 10y agoGreat article on the statistical nuance of their claims. But even before you get that far, you also need to address the fact that national highway statistic they are comparing to is highly misleading. Like gnicholas mentioned, the age, price, geographical distribution, weather conditions in which autopilot runs, and typical owner characteristics of a Tesla, all differ sharply from your average car which rides in the highway. And, I'd suspect if you zeroed in on proper comparables, all of these factors would drive the average highway safety way up. So not only is their claim yet statistically unproven, they are also setting themselves an artificially low bar.
- deegles 10y ago> all of these factors would drive the average highway safety way up. Up? Why not down? More data could easily show the opposite.
- vkou 10y agoDriving on a divided highway is safer then an undivided one. Driving in conditions where you can use cruise control is safer then in ones where you can't. (Snow, ice, sleet, heavy rain, poor visibility.) I'm not sure where driving on a highway falls compared to city driving.
- ChicagoBoy11 10y agoWhat I was trying to get at is that the benchmark that Tesla is using as comparison (1 fatality/94 million highway miles) takes into account all highway vehicles. Tesla is a high-end, expensive, luxury vehicle, and the autopilot also does not function in certain conditions (like heavy rain). It would seem to me that if you just took into account other luxury vehicles, and excluded really adverse driving conditions, that the 94 million mile number would probably be higher, and I think that would be a fairer comparison for Tesla to use if they want to claim the car is faster than human driving. Are you trying to say that you think taking these factors into account would actually make comparables comparitively less safe?
- 10y ago
- mhneu 10y agoThe naming of Autopilot was likely originated by Tesla's marketing department. Just like the blog post this article critiques was likely written by content marketers, or even more likely, by a collaboration between top-level marketing and engineering officers. The success of the Autopilot feature is a critical aspect of Tesla's business and all communications about it certainly rises to the C-suite. Edit: the success of self-driving cars in 2016 is more about reputational and liability risk than it is about engineering effort. A self-driving car rollout effort by any company is being driven (no pun intended) by legal and marketing, not engineering.
- rhino369 10y agoThe 94 million mile mean is for all types of driving, in all types of situations, all types of people, in all types of cars. First and foremost, highway driving is much much much safer than regular driving. There are no intersections (which cause 40% of all accidents), there is high viability, slow turns, no pedestrians, and a super simple traffic pattern. Autopilot is only doing the "easy" driving. Second, that 94 million miles figure includes motorcycle deaths. Motorcycles have 34X more fatalities per mile driven. That juices the number of fatalities per mile. Demographics matter too. Telsa owners are disproportionately older than average (not a lot of teens driving Teslas). They are more educated and richer. These people tend to be safer behind the wheel on average. Telsa's also have a lot of safety features that should reduce fatalities to way below median anyway. If you want to test if Autopilot is safer you have to test it against a control group that is the same but just didn't use Autopilot.
- gnicholas 10y agoCompletely agree with most of these points, but the demographics one is actually a mixed bag. Fatalities plotted against driver age follow a U-shaped curve [1], with younger and older drivers being the most likely to cause a fatality. The U is higher on the younger driver side of the curve, but this is likely due in part to the fact that teens have less money and therefore drive cheaper/less safe cars. Because Tesla owners probably skew older, we might expect to see slightly more fatalities with Teslas than with other vehicles. The male/female fatality rates [2] are also relevant, and I would guess that Teslas are driven more by men than women. (My estimation of Tesla demographics is based on my commute down Sand Hill road, so not scientific but probably the highest-traffic area for Teslas.) Lastly, I haven't seen data that wealthier people are safer drivers than poorer people. Source? It's believable, but I have looked in the past for data on this and not seen this particular conclusion. 1: https://www.aaafoundation.org/sites/default/files/2012OlderDriverRisk.pdf https://www.aaafoundation.org/sites/default/files/2012OlderD... 2: http://www.cbsnews.com/news/men-vs-women-who-are-safer-drivers/ http://www.cbsnews.com/news/men-vs-women-who-are-safer-drive...
- jsprogrammer 10y agoWe don't know if we have accurate fatality numbers for Teslas though. IIRC, the first fatality was unreported for a couple months.
- Animats 10y agoThat's a superficial analysis. Tesla's MTBF has been discussed here before. For one thing, Tesla's auto-driving is only expected to work on freeway-type highways, and fatality rates for those are lower than for all driving. Tesla's "autopilot" now has a second fatality, in China.[1] There's dash cam video. "When it was approaching the road sweeper, the car didn’t put on the brake or avoid it,” a police officer said in the CCTV report. “Instead, it crashed right into it." Take a look at the photo. It's possible that the big rotating brush behind the street sweeper didn't produce a radar return. Remember, Tesla's radar is only at bumper height. Teslas are radar-blind at windshield height. The rear profile of the street sweeper truck, which is high off the ground, may not have been recognized as a vehicle by MobileEye, especially since the street sweeper is throwing up dust. Video: [2] So far, there seem to be at least two Tesla autopilot defects that can kill people: #1 is a high obstacle. That was the trailer crash fatality. It's also the auto-parking failure where the vehicle didn't stop for a truck with overhanging ladders out the rear.[4] Teslas are radar-blind at windshield height, and if it doesn't look like a car or truck rear end, the Mobileye vision system won't see it. #2 is a left side obstacle partially blocking a lane. There are two videos of crashes in this situation.[2][3] The "how big is the open space" vs the "how wide is the vehicle" analysis may be defective. #1 is the result of an under-sensored system with a huge blind spot. #2 may be a software bug. Looking forward to the NTSB report. Nothing new from them yet. [1] http://www.nytimes.com/2016/09/15/business/fatal-tesla-crash-in-china-involved-autopilot-government-tv-says.html?_r=0 http://www.nytimes.com/2016/09/15/business/fatal-tesla-crash... [2] http://www.dailymail.co.uk/news/article-3790176/Shocking-dashcam-footage-shows-Tesla-Autopilot-crash-killed-Chinese-driver-futuristic-electric-car-smashed-parked-lorry.html http://www.dailymail.co.uk/news/article-3790176/Shocking-das... [3] https://www.youtube.com/watch?v=qQkx-4pFjus https://www.youtube.com/watch?v=qQkx-4pFjus [4] http://www.roadandtrack.com/new-cars/car-technology/news/a29133/tesla-self-driving-crash-summon-autonomous/ http://www.roadandtrack.com/new-cars/car-technology/news/a29...
- mdorazio 10y agoTesla contests that the China fatality was due to autopilot (they say it may not have been active). But in actuality, it doesn't even matter that the sweeper was throwing dust - autopilot straight up can't detect and avoid stationary objects in some situations, regardless of ground clearance. Here's an example of it hitting a normal van stopped in the left lane: https://electrek.co/2016/05/26/tesla-model-s-crash-autopilot-video/ https://electrek.co/2016/05/26/tesla-model-s-crash-autopilot...
- etendue 10y agoI think this point from the post deserves emphasis, for consideration in future discussions: > If Tesla makes a "major" change to software, pretty much all bets are off as to whether the new software will be better or worse in practice unless a safety critical assurance methodology (e.g., ISO 26262) has been used. (In fact, one can argue that any change invalidates previous test data, but that is a fine point beyond what I want to cover here.) Tesla says they're making a dramatic switch to radar as a primary sensor with this version. That sounds like it could be a major change. It would be no surprise if this software version resets the clock to zero miles of experience in terms of software field reliability both for better and for worse. I am admittedly a broken record on this point, but Tesla moves very fast and very nimble on a system that is under design controls. It would be very educational to learn about their development process and how it maps to ISO 26262.