27 ms·
Tesla FSD data is getting worse, according to beta tester self-reports
- bin_bash 4y agoI just tried FSD last night in suburban Dallas for the first time with light traffic and it was harrowing. Drove in the wrong lanes, almost hit a trash can, accelerated way too fast on side streets, and it made a right turn at a red light without stopping or even coming close to slowing down. This was a 3 mile drive. I've been using autopilot on the freeway for years and that's been mostly fine—but I'm never going to use FSD on streets again.
- SketchySeaBeast 4y agoDid you actually keep it on those whole 3 miles? I would have stopped after the first near miss.
- bin_bash 4y agoI disengaged twice because I was terrified of what it might do but turned it back on. I'm generally a very early adopter with these kinds of things (I'm the type of person to always turn on "Beta" mode regardless of what I'm working with). So I have a high tolerance for things not working the way they should. This is unbelievably terrible though. I really regret purchasing it.
- Zigurd 4y agoThis makes me feel like running an Android beta on my daily use phone just isn't that daring.
- mcculley 4y agoThis thread and the other comments on this post are amazing. One cannot sell a car without a seatbelt, but Tesla can use their customers for beta testing a dangerous system that drives a whole car around.
- jacquesm 4y agoIt would seem like a return and a refund for selling a defective product is in order.
- masklinn 4y agoI expect that's exactly why you're paying to be a beta tester: they can keep your money and not deliver anything. The one time I really beta tested a for-profit product, not only did I get it for free, I actually got a rebate on the final product (it was pycharm, and jetbrains gave me a free license for a year, which they got back many times over as I renewed yearly ever since). Though I guess the early accesses I got for kickstarters were kinda like paying for a beta in a way.
- jacquesm 4y agoI don't think 'beta tester' is a recognized class in terms of consumer law. You're a customer, a merchant, a manufacturer or a bystander. Besides that for something that costs that kind of money you can simply expect it to work.
- tqi 4y ago> I'm generally a very early adopter with these kinds of things Which in turn makes everyone else around your car an early adopter?
- Cshelton 4y agoBy that logic, all drivers are early adopters every time a new driver gets their license and enters the "driving pool".
- deleted 4y ago[deleted]
- ska 4y agoIsn't that why lots of of jurisdictions have constraints on the learning driver (e.g. graduated licensing of some sort) and/or visibility requirements (e.g. car has to have a "learner" sticker of some sort) so that other drivers know?
- maximus-decimus 4y agoI literally never heard of such stickers.
- paulryanrogers 4y agoWe had them in the Midwest US. And the learner vehicles have an extra break pedal for the instructor. Which is good because a student in my group nearly killed us trying to merge into a semi.
- sifar 4y agoThey probably are to some extent, and you know where the liability would lie if they are responsible should something bad happen. What about this case ? There is no sense of responsibility or realization of the danger they are introducing at scale . Even when they actually admit that they have failed at it [0]. I am not sure if they are aware of the doublespeak in this admission. [0] Failure to realize a long-term aspirational goal is not fraud.
- fiddlerwoaroof 4y agoI’ve been using FSD for a month and my experience with it has been mostly great. I was skeptical initially because of the prevalence of this sort of comment online but it didn’t match my experience. There are predictable situations where it can’t navigate but you get used to them and anticipate them. Otherwise, it is a nice upgrade in functionality over EAP that generally makes the car nicer to operate.
- bin_bash 4y agoOne thing I maybe should've mentioned is that it was dark outside (not raining or anything though). Maybe I'll try it again in the daylight one day.
- influxmoment 4y agoIs your experience the norm though? Uncut YouTube videos show a reliable FSD in many conditions
- paulryanrogers 4y agoSelection bias perhaps? Fanboys are most likely to upload, and not talk up the disengagements--even if caught on camera.
- bin_bash 4y agoIf a cop would've been behind me I would not have been surprised if they pulled me over thinking I was drunk. The car kept driving erratically, switching lanes and turning the turn signal on and off. If you would've been next to me you'd be fearing for your life If we assume I just got repeatedly unlucky and this was a 1:1000 situation would that be acceptable to you?
- deleted 4y ago[deleted]
- Sodman 4y agoI have FSD Beta. These uncut youtube videos were a large reason of why I bought into FSD Beta, and I will say they show it in a much better light than my on-the-ground experience. I'm not even accusing the posters of selecting only good videos to begin with (although I'm sure that's also happening) - but the videos really don't do justice to the "in the car" feeling. As a specific example, when the car suddenly slams on the brakes, especially at slow speeds, it doesn't look like a big deal on these GoPro cameras - but it feels like a much bigger deal when you're in the car and you feel the g-force of your body reacting to the sudden unexpected deceleration. Some of the more transparent and honest reviewers like "Chuck Cook" even add an overlay showing these forces in real time on their videos - but seeing a number briefly spike is a very different experience than feeling it live. I would say FSD is getting closer to "safe" (not there yet though imho) but it's still very far away from "comfortable".
- ljlolel 4y agoWorse is that Tesla is no longer releasing the safety data quarterly as promised. Not exactly hard to report this as they already have been doing it. Suspicious to stop reporting since 2021. We want this data! https://www.tesla.com/VehicleSafetyReport https://www.tesla.com/VehicleSafetyReport
- geocar 4y agoAm I misreading that? They're comparing accidents of tesla owners against people belonging to different demographics and circumstances!? An equivalent improvement in driving safety might also be had by eliminating drivers under 30 and since those aren't Tesla drivers (the average Tesla owner is a 54 year old white man making over $140,000 with no children) this self-driving malarky would have zero safety impact.
- ljlolel 4y agoTheir more numbers of more affordable cars is probably why their safety data is getting worse and why they're not releasing it any more (I support tesla by the way just wish it were transparent about safety).
- sanedigital 4y agoWhen our Model 3 got access to FSD, my 6 year-old desperately wanted to try it out. I figured a low-traffic Sunday morning was the perfect time to test it out, so we headed out to grab Mom a coffee downtown. The car almost caused an accident 3 separate times. The first, was when it almost drove into oncoming traffic at an intersection where the road curves north on both sides. The second, was when it failed to understand a fork on the right side of the road, swerved back and forth twice, and then almost drove straight into a road sign. The third, in downtown, was when a brick crosswalk confused it on a left turn, causing it to literally drive up onto the corner of the intersection. Thank God there weren't pedestrians there. When we upgraded to a Y, I turned down FSD. I don't imagine I'll be paying for it ever again.
- judge2020 4y ago> Thank God there weren't pedestrians there. It would've still stopped - the FSD system doesn't override the background tasks that power the AEB systems that stop the car from hitting humans or cars.
- onlyrealcuzzo 4y agoExcept that time FSD drove right into a semi truck and killed the guy sleeping in his car...
- sharpneli 4y agoYou mean it would disable FSD when it would see that impact was inevitable so Tesla could claim that FSD had nothing to do with the accident.
- judge2020 4y ago> To ensure our statistics are conservative, we count any crash in which Autopilot was deactivated within 5 seconds before impact, https://www.tesla.com/VehicleSafetyReport https://www.tesla.com/VehicleSafetyReport
- hello_friendos 4y ago
- sethd 4y agoI know that a lot of Tesla fans view FSD as a sort of tip jar to throw extra money towards the cause but I have a feeling regulators and gov attorneys will come to see it quite differently.
- bin_bash 4y agoYeah I would've been one of these fans until I tried FSD yesterday (see my other comment). I suspect now that it's been GA for a week or so a lot of people are going to change their mind like I did.
- paulryanrogers 4y agoHow has your mind changed? Was it based on aggregate stats or anecdotes?
- bin_bash 4y agoI actually used it myself. It's worse than I ever imagined it would be.
- ProjectArcturis 4y agoI'm kind of amazed there hasn't been more government action on this.
- sshine 4y agoI've commuted a bit on the German highways. I only run Autosteer, which is cruise-control + lane-control, and it disengages almost every time there's roadwork. It is very bad at handling ambiguity when the road has both white and yellow navigation lines. There's a number of scenarios, some of which involve criss-crossing lines, some where they run mostly in parallel. The car sometimes wants to follow the white lines when the yellow are actually overrides. When the yellow lines are wrong (and should rightfully have been scraped off), this always leads to disengagement. For stretches where the yellow lines are correct, and the older white lines are off by half a meter so that there's effectively not enough space between the white lines and the concrete side, autosteer will sometimes try to switch to the white lines, which would lead to the car smashing into the concrete side. And sure, autosteer != FSD. But it's a much simpler problem that the Tesla still basically fails at. Sometimes, in fog, cruise-control will abrubtly break. Very nerve-wrecking. Relying fully on vision has its downside. Listening to Kaparthy on Lex Fridman's podcast, it sounds like this was cost-cutting. I can't believe that "nope, that big white thing isn't a wall" is not objectively better navigation.
- Zigurd 4y agoThis is an example of the risks of vertical integration. Some of what Tesla needed/chose to do itself is paying off. More integration into a single electronics system puts Tesla ahead of an industry trend with many unique features. But rolling your own ADAS and FSD might result in having spent a lot for a result that is inferior to what ADAS suppliers can sell to other car OEMs, with no substantial benefit to the FSD effort, which is much riskier, with the added, and perhaps gratuitous risk of trying to do FSD with only camera sensors. The risks in that are not just it is a risky approach to real time sensor data, but that the data all your cars are collecting is worth a lot less for not having a LIDAR point cloud providing 3D data.
- dmix 4y agoI’m most curious how Teslas autosteer compares to CommaAI (or other offerings). I’ve been seriously considering letting CommaAIs set of supported cars to try it out. It’d be cool if there was a yearly competition to rank the basic lane keeping/speed matching/turning. Eventually when it’s actually full-self-driving they can rank FSD.
- ajross 4y ago
- leesec 4y agoNot sure why this was downvoted lol. If everyone can happily share their stories of autopilot failing without being downvoted why not a positive case?
- pmarreck 4y agoIt’s one thing to report your positive experience. It’s another to presume that everyone else who is reporting a negative one is just a complainer, because you’re assuming that you and them have equivalent experiences. “This software is working, folks!” is an example of that; so is the presumption that the complainers are simply caught up in “Tesla/Musk hate”
- TulliusCicero 4y agoIt's pretty damn obvious why it's being downvoted, or did you not make it through the whole comment? > But this software is working folks. It's going to happen. As I see it our choice is either to celebrate the advent of new technology or hide behind comment vote buttons trying to pretend that it isn't. > For me, I'm happier watching it than I would be being a luddite. I'll take my downvotes now, thanks. Snarkily dismissing everyone else's experiences as invalid isn't a great way to endear yourself.
- deleted 4y ago[deleted]
- frosted-flakes 4y agoBecause AJ explicitly asked to downvoted.
- pmarreck 4y agoThe downvoting is for this: You presume that your own experience is the same as everyone else’s (regardless of differing driving conditions, etc.), and thus, that everyone else is being overly critical of their (assumed to be similar) experiences. There’s a term for this: Gaslighting.
- helf 4y agoI just, you know, steer my Volt. With my hands. And eyeballs. If I need to do something on a drive I get my wife to drive. I honestly do not understand the obsession with self driving or driver assist. I drove a Ford with active lane assist and having the car physically move the steering wheel is the worst. But apparently Im one of those weirdos who actually enjoys driving.
- Zigurd 4y agoStopping humans from driving cars could save many lives. A million people worldwide, die in road accidents every year. Half are cyclists or pedestrians. But I tend to believe Gill Pratt, at Toyota, who says he doesn't know how to make level 5 AVs, more than I believe Elon.
- Drunk_Engineer 4y agoWhile nobody knows how to make a level 5 AV, we do know how to eliminate road deaths: https://www.theguardian.com/world/2020/mar/16/how-helsinki-and-oslo-cut-pedestrian-deaths-to-zero https://www.theguardian.com/world/2020/mar/16/how-helsinki-a...
- rootusrootus 4y agoA third of all fatalities are caused by drunk drivers. That's easier to solve than self-driving cars. Another big chunk are weather related, driving at night, driving while sleepy, etc. The median driver is pretty safe, there are better ways to spend money than building automated car toys for them to play with.
- Zigurd 4y agoThat may be a US number. Other places that have stricter drunk driving laws, or that culturally have less drinking, can also have much worse road safety. AVs can also solve other problems like efficiency and surge-ability in public transportation. Not just a toy for the rich.
- mplanchard 4y ago
- maxcan 4y agoThis is relatively consistent with my experience using the FSD Beta in and around Miami with one major caveat. With two exceptions, all of my disengagements have been "quality of life" disengagements where I disengaged for reasons other than safety: * to take a different route or get in the correct lane * to be polite / courteous to a pedestrian who wasn't yet in the crosswalk * to move more quickly through a construction zone or other traffic irregularity. In none of those cases did I believe that the car was going to cause any risk of an accident, at best there was risk of pissing someone off (which, to be fair, in a city like Miami with far more firearms than judgement could be fatal, but not due to car at all). So yes, these are disengagements, but they weren't dangerous. There is one case where I do get dangerous disengagements. At the intersection pictured below, when I'm in the position of the white van, sometimes tesla will mistake a green on the far traffic light (which is for the other road, intersecting at a sharp angle) for my road and proceed if it is green even though it is red. Happened twice, haven't noticed on the last version yet. Intersection here: https://www.google.com/maps/@25.750348,-80.2061284,3a,75y,262.35h,77.07t/data=!3m6!1e1!3m4!1sf0wQfJXQ-_WKki68FrMMSg!2e0!7i16384!8i8192 https://www.google.com/maps/@25.750348,-80.2061284,3a,75y,26...
- ccorda 4y agoThe original data source of all this breaks this out into "Critical Disengagements" (CDE) and Non-Critical. * Critical: Safety Issue (Avoid accident, taking red light, unsafe action) * Non-Critical: Non-Safety Issue (Wrong lane, driver courtesy, merge issue) That both Fred from Electrek and Taylor from Snow Bull ignore this distinction shows me their intent is less than neutral. Looking at the original data sources [1], FSD seems to be improving over time at the metric that matters most: * City miles per CDE have gone from ~50 to ~120. * % of drives over 5 miles with no CDE have gone from 72% to 93%. I've been pleasantly surprised that human oversight while the software improves seems to be a viable approach. FSD doesn't appear particularly close to Waymo/Cruise at the moment, but it's not as if they are crashing left and right (you'd certainly hear about it if they were). Personally I have it, I don't find it enjoyable to use -- but I also don't feel unsafe when using it. Highway autopilot on the other hand I find immensely reliable and valuable. [1] https://www.teslafsdtracker.com/ https://www.teslafsdtracker.com/ https://twitter.com/eliasmrtnz1 https://twitter.com/eliasmrtnz1
- pmarreck 4y agoMusk has tweeted about the importance of transparency/candor https://twitter.com/elonmusk/status/1598858533608431617?s=46&t=Hy0FCOHROzEvXstB_oF3oQ https://twitter.com/elonmusk/status/1598858533608431617?s=46... and yet does not release recent FSD safety data. This is simply hypocritical.
- outside1234 4y agoIt is not hard to imagine that Tesla is going to die at this rate. Where the moat? Traditional car makers are catching up on electric and already have superior build quality. And if anything, Tesla is behind on FSD.
- bin_bash 4y agoStill superchargers for now
- foepys 4y agoIn Europe there is regulatory pressure to open all publicly accessible charging stations to be open to all vehicles. If superchargers are Tesla's main advantage, they are not only in competition with auto makers but with all electricity providers in an increasingly competitive market.
- _ea1k 4y agoMy other car with TACC and autosteer claims to be a pro pilot, but can't handle a shallow curve and also accelerates towards stopped traffic fast enough to trigger its own collision warning. Tesla will be fine.
- rootusrootus 4y agoSupercharger network is the only moat. In all other respects other EVs beat Tesla feature for feature. Maybe the gov't will squash FSD and Tesla will have an epiphany and decide to refocus their efforts on the basics where they're quickly falling behind. Hell, maybe they'll start including the better technology the competition relies on, and try to stick to just the things they're good at. Which is ... I don't know. Image seekers?
- mrcwinn 4y agoTesla is certainly behind on FSD. What that team has produced so far is nothing short of amazing, but gosh, their boss sure hasn't helped their credibility. I can say that after experiencing the software of the BMW i4 and the Audi e-tron — holy cow, Supercharger is certainly not the only advantage of a Tesla. Audi's is laughably bad. BMW's is better than Audi's. Both are much worse than Tesla. The obvious retort there is: but Tesla's competitors will get better. And sure, they will. You're right. But Tesla likewise has their own R&D investments and unreleased products. I think sometimes when we talk about competitive landscape, we tend to say "Company B will catch up to Company A" while in our minds falsely imagining Company A as being static. Both Company A and B are moving, but in Tesla's case, they had a ten year jump on tightly integrated hardware + software. I think it's likely that continues to yield dividend.
- Sohcahtoa82 4y agoOne of the comments points out: > Comparing Telsa's disengagements for its FSD beta, which can drive anywhere, against autopilots that work only on (certain) highways is not very comparable. At least compare highway to highway disengagements. I own a Tesla, but do not have FSD (Not interested in it at all beyond being a party trick). After 3 years and 20,000 miles, I can say that I've never had to disengage AP because of imminent danger, though I HAVE had many times where the lane is splitting and AP can't decide which way to go, so I had to take control. Likewise, when a lane is merging, it would sometimes jerk left and right a bit and I'd take over. Both cases were more for comfort than safety. Total, I'd probably average 5 miles per disengagement, but that's just so I can change lanes since the base AP does not include lane changing.
- dummydata 4y agoI have the exact same experience with AP. I trust it on highways until a merge or lane split is ahead. I think it's so silly that the decision making isn't more robust.. If I can't trust AP with simple road rules, then why bother upgrading to FSD?
- fiddlerwoaroof 4y agoFSD handles road rules significantly better: the road up to my house has a complicated five-way intersection with a railroad crossing that EAP could never handle. FSD navigates it perfectly. For my 40 minute compute, there are about three spots where there’s predictable road issues that force me to disengage (no safety issue, just the car gets really hesitant) but otherwise it’s obviously an upgrade from non-FSD.
- Waterluvian 4y agoSomething interesting to me, as someone with a 2020 base-level Forester, is that you describe my experience completely. It works great on most highways, but needs me when lanes split or merge. Of course it's not 1:1. AP has other features, such as a much nicer UI that better reports what it thinks it sees, and I think has sexy lane changing features and such. But it makes me feel that FSD was more business necessary to keep a competitive advantage against cheap cars. Soon many cheap cars will have AP-like features at comparable fidelities.
- rootusrootus 4y agoI think 'awful' is underselling it a bit here. The fact this is allowed to be in widespread use in the hands of amateur 'beta testers' is horrifying. I'm surprised USDOT hasn't put the kibosh on it yet.
- buildbuildbuild 4y agoRanking by miles per disengagement without context as to which roads the vehicles drove on does not feel like the most useful metric. (On a track? In a well-mapped city? Cross-country on highways?)
- cma 4y agoLimiting to a well mapped city should be a point in favor of Cruise and Waymo, they are operating it with more restraint. Normalize for the raw difficulty of the area (city vs highway, etc.), but don't penalize for taking steps to make their operation area safer (hd mapping it).
- ivraatiems 4y agoI want to understand the minds of engineers at Tesla - or anywhere - who willingly put this kind of stuff out into the world. How do you convince yourself Tesla FSD is safe enough to ship? Are you just so worried about your boss being mad at you that you don't care? Are you so bought-in that you ignore obvious signs what you're doing is dangerous? It's engineering malpractice to test this product on public roads, in my view. It's beyond malpractice that the government - at city, state, and federal levels - is allowing it. (To be clear, I am not against self-driving cars in all instances. I am talking specifically about the Tesla FSD, which has been dangerous since launch and isn't getting better.)
- ff317 4y agoThe counterpoint goes something like this (not that I necessarily buy it, but this is what I infer to be Tesla's reasoning): 1) We're only going to fully "solve" self-driving with ML techniques to train deployed NNs; it can't be done purely in human-written deterministic code because the task is too complex. 2) Those NNs are only going to come up to the necessary levels of quality with a ton of very-real-world test miles. Various forms of "artificial" in-house testing and simulation can help in some ways, but without the real-world data you won't get anywhere. 3) Deploying cars into the real world (to gather the above) without some kind of safety driver doesn't seem like a great path either. There's no backup driver to take over and intervene / unstick the car, and so far driverless taxi fleet efforts have been fairly narrowly geofenced for safety, which decreases the scope of scenarios they even get data on vs the whole real-world driving experience. 4) Therefore, the best plan to acquire the data to train the networks is to use a ton of customers as safety drivers and let them test it widely on the real routes they drive. This is tricky and dangerous, but if it's not too dangerous and the outcome saves many lives over the coming years, it was worth it.
- ivraatiems 4y agoI could see something like this being their logic - maybe not with neural networks/machine learning specifically, but certainly "the only way to get to where we want to go is to do this". My counter-counter-point would be that there's plenty of other companies that are doing this more safely, and also that ends don't justify the means when those means involve killing pedestrians.
- deleted 4y ago[deleted]
- rafaelero 4y agoTesla FSD may be bad, but no way it is that much worse than Cruise. Looks like they are inflating their data.
- bagels 4y agoWhy do you say this?
- rafaelero 4y agoAre you kidding? 40k km with no disengagement? This is nuts. I don't think we have reached that level yet. And if we did, I can't believe Tesla engineers would be so oblivious to that that they wouldn't update their technology. The likeliest explanation is that the article's chart is using some weird metric that is not comparable between automakers.
- ahelwer 4y agoYou've given no actual reasons you find this hard to believe, just running on 100% vibes. The data reported to regulators doesn't lie. Tesla really is that far behind the competition.
- threeseed 4y agoI would not be surprised at all. The biggest problem with FSD is bounding box detection as from previous videos it routinely fails to identify objects in the road correctly. A problem that LiDAR (which Cruise uses) is especially good at.
- rafaelero 4y agoThat magnitude of a difference would be pretty noticeable and I haven't seen Cruiser users posting amazing reviews on YouTube in comparison to Tesla's. Maybe I am using an incorrect proxy, but it's hard to believe that Tesla would be so far off.
- 4y ago
- devmor 4y agoI briefly tested FSD out on a Model 3, for about a mile and a half on what was mostly a clean, recently painted 2-lane road. It seemed to be okay until I got to the point the lines broke for an exit and then it tried to drive me into a concrete median. I trust the lane-keep feature on the old 2017 Corolla I rented more than FSD.
- killjoywashere 4y agoI have been driving Tesla FSD 10.69 for the last few weeks and it is far from perfect. It's definitely beta level software, and unfortunately, there's no real distinction between beta web frontend and beta life-critical ASAD. I routinely have to take control. It definitely accelerates to hard on some sleepy side streets. It's extremely conservative about speed and lane changes. It's terrible at anticipating slowing where humans obviously would, like brake lights stacking back toward you on a curving highway: the driver can see the braking problem coming from a thousand yards ahead, maybe miles. Summon is slightly better than a parlor trick. FSD is approximately useless in parking lots. But.... It's not completely unusable. There are definitely segments of a drive I can mentally relax (back to my normal driving level of attentiveness). Having gotten two kids through their driving tests recently, I'm struck how much FSD 10.69 resembles a 16 year old with their early driver's permit. They're terrible. But they are learning really fast. Similarly, Tesla is now getting millions, if not billions, of disengagements coming back for retraining. The next release is going to be better.
- VBprogrammer 4y ago> can mentally relax (back to my normal driving level of attentiveness). I'm not sure if this was intentionally funny but it made me laugh.
- rootusrootus 4y agoIt sounds accurate to me. If you are a defensive driver, you will most likely find that even basic autopilot increases your stress substantially. It happily drives you full speed into situations your brain easily recognizes as risky. Personally I'd probably have palpitations if I tried FSD.
- bestcoder69 4y agoDamn I can't wait to try neurolink.
- ryanwaggoner 4y agoI don't understand how regulators and insurance companies are so asleep at the wheel (hehe) around this. It seems insane to me that you can just start selling a car that you claim can drive itself without any kind of certification or safety data being provided.
- wnevets 4y agoDoes anyone else remember being told Tesla owners would be able to rent their cars out automatically to Uber/Lyft when they weren't using them because of the FSD?
- runlevel1 4y agoTesla Autonomy Day 2019-04-22: "By the middle of next year [2020] we'll have over a million Tesla cars on the road with FSD hardware feature complete at a reliably level that we would consider that no one needs to pay attention. Meaning you could go to sleep. From our standpoint, if you fast-forward a year, maybe a year and 3 months, but next year for sure we will have over a million Robotaxis on the road. The fleet wakes up with an over-the-air update. That's all it takes." Source: https://www.youtube.com/live/Ucp0TTmvqOE?t=11616 https://www.youtube.com/live/Ucp0TTmvqOE?t=11616
- sethd 4y agoI can’t believe anyone could take this guy seriously. It’s so comical at this point.
- manv1 4y agoPeople (and technical people) like to believe that one data point isn't important, that it's an anecdote and doesn't matter. But as a lawyer once said, "I convict with anecdotes." In any case the reports are interesting because with them you can start to understand the shape of the autopilot's capabilities and limitations. IMO the individual reports (like the ones here) are nice and detailed; the kind of summary data the article wants is pointless, because it doesn't include any real detail in it. Your autopilot worked on a 400 mile stretch of empty Kansas highway, big deal.
- danso 4y agoEarlier this year when Mercedes announced its Level 3 "Drive Pilot" system [0], a lot of Tesla stans mocked its limitations, which to be honest, are quite numerous on the face of it: - Only allowed on limited-access divided highways with no stoplights, roundabouts, or other traffic control systems - Limited to a top speed of less than 40 mph - Operates only during the daytime and in clear weather But the big promise from Mercedes is that it would take legal liability for any accidents that occurs during Drive Pilot's operation, something that Tesla doesn't appear to be even thinking about wrt Autopilot and FSD. I would love someone to goad/challenge Tesla to step up to Mercedes. If FSD is so much better than Drive Pilot, then why doesn't Tesla agree to provide a "safe mode" for FSD, that operates with the exact same restrictions as Mercedes' D-P, and offers the same legal protections to any users who happen to get into accidents during "safe mode" FSD operation? [0] https://www.roadandtrack.com/news/a39481699/what-happens-if-mercedes-drivepilot-causes-a-crash/ https://www.roadandtrack.com/news/a39481699/what-happens-if-...
- lolinder 4y agoYep. Mercedes has these limitations not because their tech is less capable than Tesla's but because Mercedes is a real car company with real engineers and a gold-standard reputation to maintain. Tesla, in contrast, is a software company that is trying to take "move fast and break things" into the two-ton 75mph vehicle space, with predictable results.
- revnode 4y agoSo Mercedes' solution is to offer a product that isn't usable? Why bother releasing it?
- ahakki 4y agoWith it's current limitations, the only application for Mercedes' solution I can think of is during heavy traffic on highways. But calling it "not usable" does seem a bit harsh. Of course if you prefer, move fast and brake... maybe
- xnx 4y agoGood example of the 2nd-order effects of how being "aggressive" on putting self-driving into the hands of drivers can cost lives. Not only can Tesla "F"SD cost lives directly through accidents, it could sour peoples' opinions of more mature driving systems like Waymo's and delay our shift to safer, automated, drivers.
- leetharris 4y agoI've had FSD for about 3-4 months and it can do the vast majority of my drives without disengagement. There are some very obvious things it still struggles with like construction and roads without clearly defined lines. But I just don't use it on those routes. I think Tesla made a mistake trying to take a "boil the ocean" approach that will work literally anywhere instead of focusing on key areas first. It ensures you need to 100% nail it before it can be considered "released" as opposed to releasing with a specific set of criteria to meet.
- misiti3780 4y agoI agree, I have been testing it for a year or so. 1. I have many many multi mile 0 intervention drives 2. it is getting a noticeably better every release Their video model will be very good in a the future if the current release pattern keeps up. Not sure what it will take to be certified by the USG as level 5, but it seems like it will be at the top of this chart in the future.
- croes 4y agoOr they will hit a wall with no further progress.
- misiti3780 4y agonot likely for a long time, given they are getting more data every day.
- naillo 4y agoFeels great seeing all this reputational damage attacks towards the one guy making the biggest impact in the incoming climate disaster.
- yks 4y agoSame guy fueling proof-of-work cryptocurrency mania? It is not entirely clear to me which direction his contribution to the carbon levels is going to end up at.
- izzydata 4y agoTesla isn't even the largest manufacturer of electric vehicles and their impact on climate change is not as great as it seems like it should be. Not to mention that launching rockets into space is like driving a million gasoline vehicles.
- adoxyz 4y agoI was one of the first people to get FSD Beta access and have given it a try every single time they pushed an update, and honestly, it's unusable and dangerous. The car just does not behave like a regular driver in any capacity. It's a neat trick to show when there is nobody on the road, but besides that, I have lost all faith in FSD ever coming out in any meaningful way. I only paid $2k for FSD ($7k total w/ Enhanced Autopilot), but even that is too much for what FSD actually is.
- _ea1k 4y agoThis seems like a pretty typical video in an area that FSD doesn't handle well: https://www.youtube.com/watch?v=xIvfNHwZsCc https://www.youtube.com/watch?v=xIvfNHwZsCc I bet this is extremely common. To be fair, we've never seen a test of Waymo or Cruise on the same road, as they are only available on certain specific roads that have been well tested. I'm not making a judgment here as to whether that is good or bad.
- jfoster 4y agoThere's so many decent quality FSD videos on YouTube. Why watch the one where you can hardly see what's in front of the car?
- _ea1k 4y agoCredibility. That's Jason Hughes who owns a third party shop that repairs Teslas. He has a long history of reporting fairly, both positive and negative. He also lives in a fairly rural area that hasn't gotten a lot of attention from FSD YTers. The fact that some of his first FSD trips showed major issues is very telling.
- jfoster 4y agoI find a video that gives a better view more credible. Chuck Cook's videos are amazing for going deep on FSD's handling of some very specific driving scenarios. He even usually has a drone overhead to give a better view of the surrounds.
- p0pcult 4y agoHas anyone posted on "free speech absolutism" Twitter 2.0 yet? Wonder what happens to that account?
- jefft255 4y agoI'm the first to complain about Tesla overselling their self-driving abilities, but I think the numbers used in this article are misleading. Miles per disengagements comparisons between Waymo (to pick one) and Tesla is like apples to oranges. Waymo operates in a closed fashion, is a laboratory-like setting (1), and I don't believe for one second that their miles per disengagements would be significantly better than Tesla in the real-world open settings that Tesla's FSD is being tested in. These numbers mean nothing when the environments used to compute them are so vastly different. (1) Here's what I think is the case for Waymo's operations: - Phenix AZ only (maybe one more city?) -- Amazing sunny weather -- Clear line markings -- Can overfit to said city with HD maps, handcoding road quirks, etc - Waymo employees only -- Not to sound to tinfoil-hat, can we really trust this data - Even within Phenix, some filtering will happen as to which route are possible
- deleted 4y ago[deleted]
- jquery 4y agoAfter seeing what musk did to twitter it’s pretty clear the emperor has no clothes, and his main asset is being a tyrant and taking the surplus value of the 80-100 hour weeks his peons do for their lord. Musk is no Steve Jobs, despite clearly seeing himself that way. Full Self Driving will get nowhere under Musk.
- 93po 4y agoComparing Musk to Jobs is ridiculous. The scope of what they've done and what they're aiming for is vastly different. One person made cool phones, the other one is putting humans on mars. Why would you think Elon wants to be a computer seller? > his main asset is being a tyrant and taking the surplus value of the 80-100 hour weeks his peons do for their lord. Cool, I agree, can we start holding everyone accountable that does this? Can we maybe start with the ones that use actual slave labor? Where are the dozen articles a day about those people? > Full Self Driving will get nowhere under Musk. It's gotten farther than literally any other organization on the planet.
- rootusrootus 4y ago> the other one is putting humans on mars Hasn't yet. And IF that happens, and if it turns out to be SpaceX that enables it, thank Gwynn. Musk is many things, but this idea that he's some kind of genius engineer is extremely insulting to all the actual rocket engineers.
- kossTKR 4y agoKnowing little about how the FSD chip works, is the fact that it runs locally and not on some super cluster a bottleneck in performance right now? The fact that it's only in the last year or so that Stability/OpenAI and efficient hardware like before mentioned processors that can produce relatively fast and accurate results in the NN sphere makes me wonder if it's just "too early" to have self driving cars? ChatGPT still requires a supercluster to run and as a layman one would think video analysis with near zero latency would be even more demanding. Also how does it compare to to apples newer Arm based architecture and Neural Engine which as far as i know is a good example of in-house designing (not production off course).
- quenix 4y agoI don't think it would be feasible to do cloud analysis on a live video stream in self-driving context. The latency would simply be too high, and a single internet hiccup would result in a dangerous situation. So I think all the models run locally.
- ody4242 4y agoImho, if Tesla could train a huge neural network to demonstrate that self driving is possible with their sw stack, they would have done that already to let Elon Musk have it's road show with it's capabilities. (Running ChatGPT does not require a supercluster, training the model does)
- jmacd 4y agoThe price for this software is $15,000 USD at the present time.
- ff317 4y agoThe main interesting charts they're showing are about disengagement rates, but this is a pretty sketchy comparison, both between manufacturers and over time with Tesla's FSD as well. "Disengagement" is going to happen for different reasons for all of these different cases. There's the axis that runs from merely inconveniencing others (e.g. "I disengaged because I was holding up traffic by being embarrassingly slow through a turn at an intersection") to the ones where a serious accident was averted (e.g. "I hit the brakes moments before the car caused a head-on collision). There's the scenario differences that feed into thresholds for deciding to disengage: professional safety drivers on planned tasks that have been given a sort of "rules of disengagement", vs everyday normal humans getting groceries and intervening whenever they feel like it for whatever reason. There's the fact that many competitors are operating in tight geofenced, HD-mapped areas, while FSD is operating real-world all over the country. I agree that Tesla's lack of transparency is troubling here, but this article seems to be trying to pressure them to increase it by taking a dishonest tack and stack all the unknowns against them in the worst possible way. They have published basic accident statistics (in the past), and those have generally shown their automation to be a net win. In their own published stats from Q4 21 (latest available on https://www.tesla.com/VehicleSafetyReport https://www.tesla.com/VehicleSafetyReport ), the comparison they make is this: * NHSTA data says the whole US averaged one accident per 484K miles. * All Tesla cars on the road averaged one accident per 1.59M miles (so, ~3.5x better? This could also be caused by the profile of Tesla drivers rather than any real car safety difference - income, where they live, etc) * Tesla cars with some form of Autopilot engaged averaged one accident per 4.31M miles driven (~2.7x better than non-Autopilot Tesla data, and overall ~10x better than the national average).
- ncallaway 4y agoIs there a reason there aren't stats for 2022 on the VehicleSafetyReport link? Is that a typical delay (e.g. were Q1, Q2, Q3 21 reports not available in December of 2021), or have they stopped or suspending publishing the reports? I'm just not familiar enough with the site to know what is normal. > Tesla cars with some form of Autopilot engaged averaged one accident per 4.31M miles driven (~2.7x better than non-Autopilot Tesla data, and overall ~10x better than the national average). Do you know if "accident" encompasses all accidents, or is there a threshold level for severity? I'd be curious if the same patterns hold for "serious accidents" defined as someone (in any vehicle in the accident) being seriously injured or killed.
- nova22033 4y agohttps://www.thedrive.com/news/38129/elon-musk-promised-1-million-tesla-robotaxis-by-the-end-of-2020-where-are-they https://www.thedrive.com/news/38129/elon-musk-promised-1-mil... "Next year for sure, we will have over a million robotaxis on the road," said Musk on October 21, 2019. "The fleet wakes up with an over-the-air update. That's all it takes." https://twitter.com/PPathole/status/1249209968877862919 https://twitter.com/PPathole/status/1249209968877862919 Elon Musk @elonmusk · Apr 12, 2020 Replying to @PPathole and @Tesla Functionality still looking good for this year. Regulatory approval is the big unknown.
- 93po 4y ago
- stnmtn 4y agoWhat an incredible insipid comment. I'm sure if you extrapolate anything to the logical extreme it sounds silly; it doesn't make a point beyond displaying that you think so highly of this car company that you want to disregard all criticism of it.
- Animats 4y agoThe California DMV has been licensing autonomous vehicles since 2014. There are three categories of license. Testing with a safety driver is the learners permit: must have licensed driver ready to take over, no driving for hire, no large vehicles. About 45 companies have a learner's permit. Driverless testing is the next step up: no driver in the vehicle, but a remote link and observer. 7 companies have that permit. Finally comes deployment: no driver, paying passengers, remote monitoring.[1] Three companies are far enough along for driverless car deployment in California: Waymo, Cruise, and Nuro. Waymo is going about 13,000 miles between disconnects now. The remote monitoring center can reset. Waymo is still being very cautious. Only in Phoenix, AZ is the service really deployed. There's a service in San Francisco, but you have to sign up as a "trusted tester" and it's mostly Google employees. When it goes live in SF, then this is real. Waymo has a new vehicle they're showing. It's an electric van with no steering wheel. Not clear how far away deployment is. Tesla isn't even trying to qualify for autonomy in California any more. They've given up. They used to whine about being "over-regulated". What they hated was having to report all disconnects and accidents to DMV, which publishes them. [1] https://www.dmv.ca.gov/portal/vehicle-industry-services/autonomous-vehicles/ https://www.dmv.ca.gov/portal/vehicle-industry-services/auto... [2] https://www.theverge.com/2022/11/21/23471183/waymo-zeekr-geely-autonomous-vehicle-av-robotaxi https://www.theverge.com/2022/11/21/23471183/waymo-zeekr-gee...
- d23 4y ago> Tesla isn't even trying to qualify for autonomy in California any more. They've given up. They used to whine about being "over-regulated". What they hated was having to report all disconnects and accidents to DMV, which publishes them. Sunlight as a disinfectant indeed.
- killjoywashere 4y ago> partnered with Chinese automaker Geely (╯°□°)╯︵ ┻━┻ Are you telling me there are no American companies they could have partnered with? Why would you willingly give US dollars to the CCP for a free market R&D effort?
- Animats 4y ago
- aidenn0 4y ago"Don't look at the data, give me lots of money to try it yourself" is something you expect to hear from a cult leader, not an engineer.
- cjdoc29 4y agoI will say, FSD has genuinely gotten better over the last year. I would not trust it to drive without a driver monitoring it. But I've had ~20mi trips end-to-end (surface streets and freeways) without requiring disengagement. It's been a great driver assist - but it's not true FSD. That said, it still does dumb things like: * Getting in the left-most turn lane when I will make a right turn immediately after a left. This usually results in a disengagement or me having to change lanes immediately after turning. * Changing lanes, but the process sometimes makes it so that I change lanes in an intersection. This is illegal. * Not stopping at the crosswalk on the right-most lane on a red. I expect the car to stop firmly at the intersection and then slowly creep out.
- gzer0 4y agoLet me know of any other system that is even remotely close to being able to do the following: https://www.youtube.com/watch?v=qFAlwAawSvU https://www.youtube.com/watch?v=qFAlwAawSvU
- klabb3 4y agoAn average human brain with 1000 hours of training.
- izzydata 4y agoUnder no circumstance will I ever let a vehicle I am in drive itself. If you can't nearly mathematically prove the software will function as expected I am not putting my life in its hands. From the sounds of it a lot of it is controlled by what is effectively a machine learning black box. No thanks.
- seshagiric 4y agoFirst time Tesla owner and recently had opportunity to experience their full self drive feature. My findings: 1. When it works it’s just great. From maintaining lanes, speed limit, distance to other cars, auto park and summon are delightful. 2. Auto park in home garage is a bit too slow to use. But parallel parking is cool. 3. Even without a radar it worked on most roads and different lighting conditions. 4. Random speeding/ slowing is definitely present. Not like jamming into the vehicle in front of you but sudden acceleration can surprise. More dangerous was random slowing down at traffic signal, even when green and at traffic circles. 5. Overall it’s definitely good enough to show promise of self driving. They are not there yet but I would place them as one of the most advanced considering the range of functionality. 6. Still the $15k is simply way too much. You are better off with occasional $200 per month like when going on a long trip.
- klabb3 4y ago> Still the $15k is simply way too much. You are better off with occasional $200 per month like when going on a long trip. I still haven’t been able to digest how Tesla can have beta testers pay them vast amounts of dollars for improving their product, without the ability to even opt out of omnipresent and opaque data collection… For a safety critical product that the company rejects liability for. The old trope “you’re the product” is not enough to do justice to this bizarre situation. It’s like the peak Apple fanboyism a la 2010, but on meth.
- hax0ron3 4y agoIt has been obvious to me ever since, a few years ago, Musk promised that fully self-driving robotaxis were going to be on the roads a year in the future that he is a con artist and/or ridiculously over-optimistic about self-driving technology. But is this why I am seeing this article on Hacker News now? Or am I seeing it now because Musk pissed off a bunch of people who disagree with his political stances?
- diebeforei485 4y agoObviously not all miles are equal, and the others in the chart (Waymo, etc) only run their vehicles in specific areas that they have previously mapped onto their own system.
- lowbloodsugar 4y agoI know right? This is worse than the FAA! Imagine requiring that airline Pilots have to be certified on a specific jet plane? Surely we should just let any Cessna pilot hop into the pilot seat of a 747 or (haha) 737 Max. We should let just anyone fly planes. And when all those planes crash, we should point out that it's not fair to show that planes with properly trained pilots don't crash. Not all airmiles are equal! Those non-crashy airlines only use pilots with very specific training. Not the same thing at all!
- diebeforei485 4y agoTo be clear - disengagements are not crashes. People often disengage in a Tesla because the car is driving too slowly/cautiously.
- cramjabsyn 4y agoRushing half finished cars out the door, and over promising on capabilities/updates is such a flawed model. I am amazed by how many people bought in, and will be really interested to see how many people replace with another Tesla as legacy brands bring EVs to market.
- Groxx 4y agoIf it disengages rather than eagerly plowing into something, that's almost certainly for the better. This could easily be explained by a renewed focus on safety after massive amounts of negative press, and that would be a good thing. Is that the reason? Not a clue! Am I optimistic about Tesla's FSD? Not even slightly! But the "data" here is extremely shaky and there are many possible explanations beyond "getting worse".
- maxdo 4y agoYou are comparing apples to burgers. Mercedes system attacks narrow scope ( gaps in traffic approved roads, certain speed conditions) etc. They bring for that lots of expensive hardware. Tesla is trying to build general AI. Wether they will succeed or not, it's a debate. But basically Mercedes strategy is do something NOW with expensive hardware where Tesla strategy do way more in the future, with cheap, 5 y.o. hardware
- defterGoose 4y agoI was brake checked by a Tesla while driving home on the 10W the other day. My first thought was, "what the hell man, you're in the #1 lane without a car in sight in front of you?!". Then I realized that the car had probably disengaged AP and this involved the cruise control disengaging and slowing (i.e. braking) the car. I had already known that Tesla drivers using AP was a major cause of slow, too-far-following-distance driving (which is why I take every opportunity to cross in front of a Tesla doing 60ish), but this was a whole 'nother level of literally "fuck you, pay attention until you get home, asshole". /Rant. P.S. Tesla drivers are absolutely the new Prius drivers. Edit: and the fact that the behavior of "if there's a car following don't slow abruptly" isn't a 0-th level if loop in the FSD algorithm is completely inexcusable. Shit needs to be regulated now.
- narrator 4y agoAs a stock market investor that is purely self-interested in predicting the direction of stocks and who could not give a crap about your opinion on Elon's latest tweet, it's EXTREMELY interesting to see TSLA flip from getting a pass on everything to getting bad PR on everything. It's like a case study in a fall from grace of a company because of political factors. I feel like a good way to play the market with all this is to look at mainstream media news service articles about TSLA before the Twitter purchase and after the Twitter purchase and train them to spot the sentiment difference in the before and after articles. It would serve as an early warning sign that the company has been switched from being boosted or trashed. One funny thing is before the Twitter purchase, alt-right outlets like ZeroHedge were constantly mocking Tesla and predicting its imminent demise during its gigantic run up while mainstream outlets were throughly praising it. Now, it's the other way around.
- bhauer 4y agoIt truly is fascinating to what degree news coverage is politically biased. Partisanship rules everything. As you point out, the stark flip-flop of roles between left and right-leaning coverage of Tesla is almost hilarious when observed from any "neutral" point of view. Even in this HN comment thread, the emotional injection of political points throughout is both funny and disheartening.
- vkou 4y agoThe reason TSLA was ever worth anything was because everything the golden boy touched turned to gold. The Twitter acquisition (starting from his initial offer) brought expectations down to reality for everyone. Please note that his behaviour as a multiplier (and the changing nature of that multiplier) of investor value has zero bearing on whether or not the cars he sells are any good. Just like the quality and quantity of those cars had zero bearing on TSLA's stock price.
- omgomgomgomg 4y agoSeems like they are in an irreversible development hell of bugs. Probably the whole soft and hardware infrastructure was badly planned and/or implemented. If they are developing it and it is getting worse, this simply means there is a lot of technical debt and more to surface. The guy leading it has left as soon his stock vested, why not stick around and write history? Probably when waymo departed from them and they thought they will fork the code and then improve it is where it all went wrong. This also means that new devs and engineers cant make sense of the code and product, we have all inherited some of these code bases, havent we. Seen many such people who deploy much less than a mvp and then face the consequences eventually. All the mvp out there who survive the beginning at least have a solid software architecture.
- torartc 4y agoCalling it FSD ever should be considered straight up fraud.
- agumonkey 4y agoHonestly surprised, some youtube fans did test recent updates (recent as in 6 months ago) and the SDV software was capable of dealing with complex high speed, irregular traffic crossroads/ramps.
- dcow 4y agoAnecdotally this matches my experience too. I'm not even in the FSD beta and with every software update plain old auto-pilot gets less intelligent. I don't know if regulators are restricting what can be done, if Tesla is self-censoring to avoid PR issues, or what, but instead of being helpful like it used to be it's mostly just frustrating. I find myself using it less an less. All that's said from someone who otherwise loves their Tesla. Has saved many thousands on gas. Hasn't had any reliability or "panel gap" issues. And would likely buy a Tesla again.
- pcurve 4y agoIt's interesting how quickly the narrative has turned against Tesla in recent month, not just Musk but in respect to the performance of their cars.
- gwbas1c 4y agoI have a Model 3 with enhanced autopilot. My wife wanted a Model Y. I find the enhanced autopilot so glitchy that I decided to just stick with regular autopilot. Guess what: I like regular autopilot better!
- hacoo 4y agoI’m no Tesla fanboy, but it should be said that publicly reported miles per disengagement metics are complete bullshit. Different companies have wildly different criteria for “disengagement”. Those reporting 1000mi+ between disengagements (at least in urban settings) are only doing so because they aren’t counting the vast majority of events.
- calcifer 4y ago> Those reporting 1000mi+ between disengagements (at least in urban settings) are only doing so because they aren’t counting the vast majority of events. Source? Do you work at one of those companies?
- joshuanapoli 4y agoMy anecdote: I’m a FSD beta user. It seems like it has become much better lately in city driving, but somewhat worse in highway driving. I bet that both have to do with changes to “lane topology” detection, which appear in the release notes. On the highway, the car sometimes perceives a change in the lanes of the highway, for example an exit lane splitting off. This would be fine and correct, except that it can now spoil an in-progress maneuver. Previously, maneuvers around exiting the highway seemed more stable. On the other hand, the latest versions seem to have an impressively fluid understanding of the lanes around intersections, where markings aren’t necessarily visible until you are up close. In my experience, it looks like Tesla’s recent concentration on surface roads has come with some neglect of highway driving.
- tippytippytango 4y ago100mile mean distance to critical failure is an interesting number. It's long enough to create multiple, fantastic looking demos of FSD. Impressive enough to convince folks that we are almost there. But it's at least 4 orders of magnitude shy of the performance you'd need to take the steering wheel out of the vehicle. Given the current rate of improvement it's hard to see how the remaining 4 orders of magnitude will be solved in a reasonable time frame, without a radical reimagining of their entire tech stack.
- ilrwbwrkhv 4y agoI have 3 teslas but never got FSD on any of them. They are mostly for gullible people who want to pay for fairy dust. "There's a sucker born every minute." Let it be ready, then I will see reviews and only then will I pay a bit to get it.
- dqpb 4y agoIt was a bad sign when Andrej Karpathy peaced out. A director doesn't walk away from a project when it's on the verge of success.
- drchaim 4y agoCan please some manufacturer make an EV without being a connected vehicle? I want to replace my combustion car with an electric one, not a "trying to be smart and connected vehicle".
- eddiezane 4y agoMy partner and I just drove from Denver to NYC in a Model 3. We stopped using any sort of "autopilot" in the middle of Kansas when it kept randomly slamming on the breaks on an empty I-70 with clear skies in broad daylight.