11 ms·
Here is my armchair diagnosis: right before the car veers towards the barrier it drives through a stretch of road where the only visible lane marker is on the l
by lisper 9y ago
Here is my armchair diagnosis: right before the car veers towards the barrier it drives through a stretch of road where the only visible lane marker is on the left. Then the right lane marker comes into view at about the point where the lane starts to widen out for the lane split. The lines that will become the right and left lane markers of the split left and right lanes respectively are right next to the van in front of the Tesla, and at this point resemble the diamond lane markers in the middle of the split lanes. My guess is that the autopilot mistook these lines for the diamond lane marker and steered towards them thinking it was centering itself in the lane.
If this theory turns out to be correct then Tesla is in deep trouble because this would be a very elementary mistake. The system should have known that the lanes split at this point, noticed that the distance between what it thought was the diamond lane marker and the right lane line (which was clearly visible) was wrong, and at least sounded an alarm, if not actively braked until it had a better solution.
This is actually the most serious aspect of all of these crashes: the system does not seem to be aware when it is getting things wrong. I dubbed this property "cognizant failure" in my 1991 Ph.D. thesis on autonomous driving, but no one seems to have adopted it. It's not possible to engineer an autonomous system that never fails, but it is possible to engineer one in such a way that it never fails to detect that it has failed. Tesla seems to have done neither.
- jacquesm 9y agoI totally agree with your analysis. What is more worrying is that even following the rest of the traffic would have solved the problem. If you are the only car doing something then there is a good chance you are doing something wrong. Also: the lane markings are confusing but GPS and inertial readings should have clearly indicated that that is not a lane. If two systems give conflicting data some kind of alarm should be given to the driver.
- rayiner 9y agoWhen I think of self-driving car technology, I think of all of these inputs (maps, cameras, GPS, etc.) being fed into a world model from which inferences are drawn.[1] Here, the car could have known from cameras and maps that there was a lane split, and should have been able to detect that the line following was giving a conflicting inference compared to those other sources. The question is: does Tesla actually do that? Because if not, it's not really self-driving car technology. It's not a glitch in a product that's 90% of the way there; it's a fundamentally more basic technology. [1] See https://www.ri.cmu.edu/pub_files/2009/6/aimag2009_urmson.pdf https://www.ri.cmu.edu/pub_files/2009/6/aimag2009_urmson.pdf at 21-23.
- jacquesm 9y agoThe whole problem seems to me that to get a 90% solution for a self driving vehicle is now no longer hard. The remaining 10% is super hard and the degree to which the present day solutions tend to get these wrong is worrisome enough that if the quality doesn't jump up very quickly the whole self driving car thing could end up in an AI winter all of its own making. And that would be a real loss. This is not a field where 'move fast and break stuff' is a mantra worth anything at all, the stuff that is broken are people's lives and as such you'd expect a far more conservative attitude, akin to what we see in Aerospace and medical equipment software development practices. But instead barely tested software gets released via over-the-air updates and it's anybody's guess what you'll be running the next time you turn the key. I agree with you that the software should have been able to detect that something was wrong either way, either it was already halfway in the wrong lane or it was heading to be halfway in the wrong lane, a situation that should not have passed without the car at least alerting the driver. And from what we have seen in the video it just gave one inferred situation priority over the rest and that particular one happened to be dead wrong about it's interpretation of the model.
- ansible 9y agoI agree with all you've said. One of my concerns with self-driving systems is that they don't have a good model of the world they are operating in. Yes, sure, they build up 3-D models using multiple sensor types, and react to that accordingly, oftentimes with faster reflexes than a human. However, consider this situation with pedestrians A and B, while driving down a street, approaching an intersection. Pedestrian A, on the edge of the sidewalk, is faced away from the street, looking at his phone. The chances of him suddenly stepping out in front of my car are exactly 0.0%. Pedestrian B, on the edge of the sidewalk, is leaning slightly towards the street, and is looking anxiously down the street (the wrong way). The chances of B suddenly stepping out is high, and the chances of B not seeing my car are very high (because B is being stupid/careless, or else is used to UK traffic patterns). I, as a human, will react to those situations differently, preemptively slowing down if I recognize a situation like with Pedestrian B. Autonomous driving systems will treat both situations exactly the same. From everything I've read about so far, current driving systems have no way of distinguishing between those two specific situations, or dealing with the myriad of other similar issues that can occur on our streets.
- lisper 9y ago> lane markings are confusing but GPS and inertial readings should have clearly indicated that that is not a lane GPS is not accurate enough to reliably pinpoint your location to a particular lane. Even WAAS (https://en.wikipedia.org/wiki/Wide_Area_Augmentation_System https://en.wikipedia.org/wiki/Wide_Area_Augmentation_System) can have up to 25 feet of error. Basic GPS is less accurate than that. In fact, it's possible that GPS error was a contributing factor here but there's no way to know that from the video.
- jacquesm 9y agoI drive a lot with my GPS (TomTom) on and it rarely gets the lane I'm in wrong, usually that only happens in construction zones. So even if the error can be large in practice it often works very well. It would be very interesting to see the input data streams these self driving systems rely on in case of errors, and in the case of accidents there might even be a legal reason to obtain them (for liability purposes).
- aequitas 9y agoDon't navigation systems 'snap' to the most probable lane you are driving in based on general direction instead of your exact GPS coordinates? A good example of this I think is when driving in tunnels, there is no GPS info there, but the navigation shows you following the (curved) road.
- jacquesm 9y agoYes, they do that, and they rarely get that wrong. Also, the better ones have inertial backup & flux gate for when GPS is unavailable. Inertial backup could also help to detect the signatures of lane changes and turns.
- saagarjha 9y agoTry driving near a place with a lot of roads that are close together, like an airport. You’ll quickly see that snapping doesn’t really work, especially if you deviate from the route the GPS is trying to take you on.
- redler 9y agoIf you are the only car doing something then there is a good chance you are doing something wrong. I’m surprised self-driving systems don’t do this (do they?). One or more vehicles in front of you that have successfully navigated an area you are now entering is a powerful data point. I’m not saying follow a car off a cliff, but one would think the behavior of followed vehicles should be somehow fused into the car’s pathfinding.
- jacquesm 9y ago"Follow the leader" is a main ingredient in flocking behavior in birds, who rarely if ever collide in flight.
- danso 9y ago> What is more worrying is that even following the rest of the traffic would have solved the problem. That's what makes this example bizarre to me. I had thought that AutoPilot's ideal situation was having a moving vehicle in front of it. For example, AP does not have the ability to react to traffic lights, but can kind of hack it by following the pace of the vehicle ahead of it (assuming the vehicle doesn't run a red light): https://www.youtube.com/watch?v=EXs4qZlDWbQ https://www.youtube.com/watch?v=EXs4qZlDWbQ
- Piskvorrr 9y agoThat's a heck of an ass-u-mption. Running the red light as the n-th exponentially increases the probability you'll get into collision.
- matt-attack 9y agoPretty sure I heard an audible warning in the vid.
- jijojv 9y agoNo, that's sound you hear when you override and take over the autopilot
- thaumasiotes 9y ago> If you are the only car doing something then there is a good chance you are doing something wrong. Following this principle would probably result in a lot of people angry that their autopilot had gotten them a speeding ticket.
- bouke 9y ago> lane markings are confusing but GPS and inertial readings should have clearly indicated that that is not a lane Aside from GPS’ accuracy as mentioned in other replies, also take into account the navigation’s map material. The individual lans are probably not individually tracked on the map, but a single track per road with meta data specifying the number of lanes amongst other featerus. So even if GPS would have provided very accurate position readings, the map source material might not even match that level of detail.
- dancek 9y ago> It's not possible to engineer an autonomous system that never fails, but it is possible to engineer one in such a way that it never fails to detect that it has failed. This is a very good point: just like a human driver should slow down if they can't observe the road ahead well enough, an AI should slow down when it's not confident enough of its surroundings. This is probably very difficult to do, and I'm skeptical about your claim that an AI can be engineered to always detect its own failures. Further, I naively believe that Tesla is already doing a lot to detect conflicting inputs and other kinds of failures. Maybe being careful enough would prevent autopilot from working at all, so compromises have been made? I probably don't understand AIs well enough to understand how they can be engineered to (almost) always recognize their own failures. But if a simple explanation exists, I'd love to hear it.
- DSingularity 9y agoI feel that’s the problem. Techniques like SVM can provide reasonable definitions of confidence. Reinforcement Learning.. DNN... the mechanisms behind autonomous cars... are they able to do this??
- xiphias 9y agoNeural networks are just non-linear functions that give probabilities to classes, so yes, it can be definitely done (and is done). As Tesla's computer vision system is not as good as Waymo's, it has to choose between comfort and safety more often.
- mhermher 9y agonot an expert, but aren't the output nodes thresholded to make a decision? How far you are from the threshold might be interpretable as confidence possibly?
- xapata 9y agoFor a single perceptron, not for the network as a whole.
- 9y ago
- raisedbyninjas 9y ago>This is actually the most serious aspect of all of these crashes: the system does not seem to be aware when it is getting things wrong. Although serious, this is working as designed. Level II self-driving doesn't have automation that makes guarantees about recognizing scenarios it cannot handle. At level III, the driver can safely close their eyes until the car sounds the alarm that it needs emergency help. Audi plans to release a level III car next year, so we'll see how liability for accidents actually shakes out. Unfortunately level II is probably the most dangerous automation even with drivers that understand the limitations of the system. They still need constant vigilance to notice failures like this and react quickly enough to avoid collisions. Just imagine poorly marked or abrupt and ramps or intersections that drivers hardly have enough time to react when they're already driving. Add in the delay to notice the computer is steering you into a wall and yank the wheel can turn some of these accident prone areas into accident likely areas.
- lisper 9y ago> level II is probably the most dangerous automation I'll go further and say that level II is worse than useless. It's "autonomy theatre" to borrow a phrase from the security world. It gives the appearance that the car is safely driving itself when in fact it is not, but this isn't evident until you crash.
- TaylorAlexander 9y agoI disagree. It’s not as though level II is a hard and fast definition - Tesla wants level 4 and claims the cars possess the hardware for that already. So you’d think their level II would still be smart enough to detect these problems to some degree. It’s not a fixed system but one they keep upgrading. I would expect this nominally level II system to have more smarts than a system that is designed never to exceed level II.
- dragonwriter 9y ago> Tesla wants level 4 and claims the cars possess the hardware for that already. You can't possibly determine what hardware is required for Level 4 until you have proven a hardware/software combination, so that's just empty puffery, but even if it was true... > So you’d think their level II would still be smart enough to detect these problems to some degree. No, because the smartness of their system is about the software. They could have hardware sufficient to support Level 4 autonomy and better-than-human AI running software that only supports a less-thsn-adequate version of Level 2 autonomy. What their hardware could support (even if it was knowable) gives you no basis for belief about what their current software on it supports, except that it won't exceed the limits set by the hardware.
- mynegation 9y agoThat's probably right or very close to what is happening, but what I cannot understand: what about damn black-and-yellow barrier board right in front of the car closing in at the speed of 60mph? Some sensor should have picked up on that.
- godshatter 9y agoThis was my thought as well. Doesn't the system have the equivalent of reflexes that override the approved plan? I've been skeptical of autonomous driving since it started to become a possibility. I spend a fair amount of time making corrections while driving that have nothing to do with what's happening in my immediate vicinity. If it can't handle an obstruction in the road, how will it handle sensing a collision down the road, or a deer that was sensed by the side of the road, or even just backing away from an aggressive driver in a large grouping of vehicles in front of you? I've had to slow down and/or move off on to the shoulder on two lane country roads because someone mistimed it when passing a vehicle. I don't have much faith in how this system would handle that. Not to mention handling an actual emergency failure like a tire blowing out. I'm sure they will get there eventually, but it looks like they have conquered all the low-hanging fruit and somehow think that's enough. I'm now officially adding "staying away from vehicles studded with cameras and sensors" to my list of driving rules.
- nerpderp83 9y agoWhat is someone drives down the road with lane-marking painter? I have witnessed two or three times in my life, it used to just be funny, but now it can be deadly.
- nerpderp83 9y agoThe cars will for survival should outweigh the lane marker following algorithm. Maintaining distance and trajectory relative to things with mass is more important than coloring within in the lines.
- Tloewald 9y ago> It's not possible to engineer an autonomous system that never fails, but it is possible to engineer one in such a way that it never fails to detect that it has failed This seems to me to be a clearly incorrect (and self-contradictory) claim. It entirely depends on your definition of failure. Your analysis seems fine. The big problem is that the "autonomous" driver is using one signal (where are the lines on the edge of the road?) to the near exclusion of all others (is there a large stationary solid object in front of me?) Maybe Tesla should have hired George Hotz (sp?) if only to write a lightweight sanity-check system that could argue with the main system about whether it was working.
- lisper 9y ago> This seems to me to be a clearly incorrect (and self-contradictory) claim. I guess that means I was able to pull the wool over the eyes of all five members of my thesis committee because none of them thought so. > It entirely depends on your definition of failure. Well, yeah, of course. So? There is some subset of states of the world that you label "failure". The guarantee is not that the system never enters one of those states, the guarantee is that if the system enters one of those states it never (well, so extremely rarely that it's "never" for all practical purposes) fails to recognize that it has done so. Why do you find that so implausible?
- Tloewald 9y agoArguing that it's possible to build an autonomous that is sometimes wrong but always knows when it's wrong seems like a stretch to me.
- mturmon 9y agoA system that can sense when it is in a failure mode is analogous to a “detector” in the Neyman-Pearson sense. A detector that says it is OK when it is actually in a failure condition is said to have a missed detection (MD). OTOH, if you say you’ve failed when you haven’t, that’s a false alarm (FA). In general, there is a trade-off between MD and FA. You can drive MD probability to near-zero, but typically at a cost in FA. Again in general, you can’t claim that you can drive MD to zero (other than by also driving FA probability to one) without knowing more about the specifics of the problem. Here, that would be the sensors, etc. In particular, for systems with noisy, continuous data inputs and continuous state spaces -- not even considering real-world messiness -- I would be surprised if you could drive PD to zero without a very high cost in FA probability. As a humbling example, you cannot do this even for detection of whether a signal is present in Gaussian noise. (I.e., PD = 1 is only achievable with PFA = 1!) PD = 1 is a very high standard in any probabilistic system. Discrete-input systems can behave differently.
- walrus01 9y agoSome local knowledge: they blocked off lane to the left side is the same lane used when the express lanes are in their opposite configuration, in the morning. In the morning with the express inbound towards the city, that lane is a left-hand exit from the main flow of Interstate 5, onto the dedicated express lanes. There should be a sufficient amount of GPS data gathered from hundreds of other teslas, and camera data, that shows the same lane from an opposite perspective.
- HeyLaughingBoy 9y agoI dubbed this property "cognizant failure" I like that term. When I was involved in the medical instrumentation field, we had a similar concern: it was possible for an instrument to produce a measurement, e.g., the concentration of HIV in blood serum, that was completely incorrect, but plausible since it's within the expected clinical range. This is the worst-case scenario: a result that is wrong, but looks OK. This could lead to the patient receiving the wrong treatment or no treatment at all. As much as possible, we had to be able to detect when we produced an incorrect measurement. This meant that all the steps during the analyte's processing were monitored. If one of those steps went out of its expected range we could use that knowledge to inform the final result. So the clinician would get a test report that basically says, "here's the HIV level, but the incubation temperature went slightly out of range when I was processing it, so use caution interpreting it." Like most software, the "happy path" was easy. The bulk of the work we did on those instruments was oriented towards the goal of detecting when something went wrong and either recovering in a clinically safe manner or refusing to continue. With all the research into safety-critical systems over decades, it's hard to see how Tesla could not be aware of the standard practices.
- readhn 9y ago"here's the HIV level, but the incubation temperature went slightly out of range when I was processing it, so use caution interpreting it." there is no "slightly out of range". Its either in the range or outside. Valid or invalid, when it comes to critical tests like these. if temperature deviation is outside of acceptable deviation range then thats a system fault and result should have been considered invalid. Back in the days there was much less regulatory oversight and products like that could slip through the cracks, Resulting to deaths, missed diagnosis etc etc. The same with Teslas AP: its either 100% confident in the situation or not. If the car is not confident in whats happening - it should shut down. If that happens too often then the AP feature should be removed / completely disabled. How many more people have to get into accidents? I know, if Musk's mom (knock on wood) was a victim of this feature then things would be taken more seriously.
- HeyLaughingBoy 9y ago
- hw 9y agoI think more people need to embrace and understand the fact that we are a long way from having fully autonomous vehicles that you can just give the steering reins to from start to finish. The term 'Autopilot' gives off the wrong idea that the driver can sit back and relax while the car brings you from point A to point B safely. The same is happening with chatbots - more and more businesses think they can put a chatbot on their site and assume it'll handle everything when in fact it's meant to assist you rather than take over things for you.
- ucaetano 9y ago> I think more people need to embrace and understand the fact that we are a long way from having fully autonomous vehicles that you can just give the steering reins to from start to finish Apparently, we're not, as Waymo has shown. > The term 'Autopilot' gives off the wrong idea that the driver can sit back and relax while the car brings you from point A to point B safely. Agreed, the "but that's not how autopilots work in airplanes" canned response is irrelevant.
- jijojv 9y agoYep it took Google/Waymo 8 years to get there but Musk and Uber just wants to move fast and crash into things. Musk wouldn't be selling self-driving since Oct'16 if it's not any day now or would he ?
- greedo 9y agoWaymo has shown no such thing. In controlled, limited circumstances, yes, but in complex, poorly mapped, degraded conditions, not yet.
- sumedh 9y ago> Apparently, we're not, as Waymo has shown. Does Waymo drive at high speeds all the videos I have seen are at low speeds.
- oldgradstudent 9y ago> Apparently, we're not, as Waymo has shown. The only things Waymo has shown so far are a bunch of marketing videos and a few tightly controlled press rides.
- agumonkey 9y agoIn other words an old ambiguous parsing problem. It might be fixable in software. I'm a bit annoyed at Tesla for over reliance over painted lines. They fade, they can be covered, be outdated .. That old fail video of a SDV stuck inside a circle is not funny anymore.
- _jomo 9y ago> SDV stuck inside a circle Off topic: I never understood why this video was discussed that much, especially in order to blame SDVs. It's an example of pointless road markings and a perfectly behaving vehicle. It's like driving into a one way street that turns out to have no exit. The driver can't be blamed.
- agumonkey 9y agoI know, and partly agree. Still when you have something that hints at leaping into the future, a simplistic automata behaviour like this brings all to the ground. We'd expect at least 'cycle' detection ;)
- fpoling 9y agoEstimating errors or confidence level reliably is still one of the biggest unsolved problems in AI.
- dorfsmay 9y ago> my armchair diagnosis > my 1991 PH.D. thesis on autonomous driving Going to hide in a corner and stay quiet on HN until I forget about this comment!
- lisper 9y ago:-) Just in case you're interested: https://vtechworks.lib.vt.edu/handle/10919/38880 https://vtechworks.lib.vt.edu/handle/10919/38880 and the associated conference paper: http://www.flownet.com/gat/papers/aaai92.pdf http://www.flownet.com/gat/papers/aaai92.pdf Most of the work was done on a Mac II with 8MB (that's megabytes, not gigabytes) of RAM. The progress that has been made since those days boggles my mind.
- readhn 9y agoshameless plug! haha just kidding and WOW! Autonomous driving so early on, JPL, Google.. Im going to go hide in the corner as well.
- lisper 9y agoThe most impressive thing in retrospect is that all that work was done on 32-bit processors with ~16 MHz clocks and ~8MB of RAM. And those machines cost $5000 each in 1991 dollars. Today I can buy a machine with 100 times faster clock and 1000 times as much RAM for about 1% of the price. That's seven orders of magnitude price-performance increase in <30 years. It's truly mind-boggling.
- aeorgnoieang 9y ago> It's not possible to engineer an autonomous system that never fails, but it is possible to engineer one in such a way that it never fails to detect that it has failed. That is an extremely surprising result. How is that possible? Are you really claiming that any control system can be engineered to detect that is has failed in any possible manner? What's an example of actual real-world system like that?
- lisper 9y ago> Are you really claiming that any control system can be engineered to detect that is has failed in any possible manner? No, of course not. But it is possible to reduce the probability of non-cognizant failure to arbitrarily low levels -- at the expense of cost and the possibility of having a system that is too conservative to do anything useful.
- chmars 9y ago> This is actually the most serious aspect of all of these crashes: the system does not seem to be aware when it is getting things wrong. That’s exactly my experience as a driver: You learn to anticipate that the ‘autopilot’ will disengage or otherwise fail. I have been good enough at this, obviously, but it is sometimes frightening how close you get to a dangerous situation …
- deleted 9y ago[deleted]
- binaryjay 9y ago>Here is my armchair diagnosis: Odd how your "armchair diagnosis" matches perfectly with the top ranked comment in the reddit thread that was posted 1 day ago. courtlandreOwner 815 points 1 day ago It sees the white line on the left, the white line on the right and thinks its a big lane. Its trying to center the car in the lane.
- swedishfish 9y agoThe comment above is saying the split looks like a diamond lane marker indicating an HOV/electric car lane, so the car is centering itself on the diamond. That's a completely different idea from the Reddit comment about the car centering itself between the right and left white lines. My guess is that both inputs contributed to the car "thinking" it was following a lane.
- binaryjay 9y agoThe conclusions are the exact same. The autopilot was trying to center the car between lines. >My guess is that the autopilot mistook these lines for the diamond lane marker and steered towards them thinking it was centering itself in the lane. It sees the white line on the left, the white line on the right and thinks its a big lane. Its trying to center the car in the lane.
- MattConfluence 9y agoIs it really odd that two people could reach the same conclusion when presented with the same video?
- kensai 9y agoI don’t know you, sir, but Tesla should hire you!
- leetbulb 9y ago> It's not possible to engineer an autonomous system that never fails, but it is possible to engineer one in such a way that it never fails to detect that it has failed. Wouldn't the system doing the checking be considered an autonomous system...that could also fail?
- lisper 9y agoNo, because the monitoring system doesn't interact with an environment, so its job is much simpler. This is actually the reason that cognizant failure works.
- leetbulb 9y agoThank you for the concise answer. I was just about to ask if you have a blog, but found your website in your HN profile. I know what I am doing for the rest of the night :P PS: Funny that we've both written a double ratchet implementation in JS :)
- dawnerd 9y agoMore basic lane assist in other cars already solve this problem. 100% teslas fault. My car will disable lane assist the moment the lane gets too wide.
- drcross 9y agoSounds like an easy fix then. After that we move on to the next edge case and so on ad infinitum.
- deleted 9y ago[deleted]
- gowld 9y agoIf you are aware when you are wrong... you would not be wrong. If you are referring to assigning confidences/probabilities to decisions, this is standard in ML.
- lisper 9y ago> If you are referring to assigning confidences/probabilities to decisions, There's a little more to it than that but yeah, pretty much. > this is standard in ML. Yes, I know. But not, apparently, standard in embedded autonomous systems.
- andosa 9y ago> It's not possible to engineer an autonomous system that never fails, but it is possible to engineer one in such a way that it never fails to detect that it has failed. That sounds highly dubious. Here's a hypothetical scenario: there's a very drunk person on the sidewalk. As a human driver, you know he might act unexpectedly so you slow down and steer to the left. This will help you avoid a deadly collision as the person stumbles into the road. Now let's take a self driving car in the same scenario, where, since it doesnt have general intelligence, it fails to distinguish the drunk person from a normal pederstrian and keeps going at the same speed and distance from the sidewalk as normally. How, in this scenario, does the vehicle 100% know that it has failed (like you say is always possible)?
- lisper 9y agoAn even more extreme example: suppose someone on the sidewalk suddenly whips out a bazooka and shoots it at you. Does your failure to anticipate this contingency count as a failure? "Failure" must be defined with respect to a particular model. If you're driving in the United States, you're probably not worried about bazookas, and being hit by one is not a failure, it's just shit happening, which it sometimes does. (By way of contrast, if you're driving in Kabul then you may very well be concerned with bazookas.) Whether or not you want to worry about drunk pedestrians and avoid them at all possible costs is a design decision. But if you really want to, you can (at the possible cost of having to drive very, very slowly). But no reasonable person could deny that avoiding collisions with stationary obstacles is a requirement for any reasonable autonomous driving system.
- andosa 9y agoWay to dodge the question. And how did we get from always knowing when you're failed to "just drive very, very slow when", when dealing with situations that human drivers deal with all the time. Let's not pretend that anticipating potentially dangerous behaviour from subtle clues is some once-in-a-lifetime corner case. People do this all the time when driving -- be it a drunk guy on the sidewalk, a small kid a tad bit too unstable when riding a bike by the roadside, kids playng catch nex to the road and not paying attention, etc etc. Understanding these situation is crucial in self driving if we want to beat the 1 fatality per 100M mile that we have with human drivers. For such scenarios, please explain how the AI can always know when it failed to anticipate a problem that a normal human driver can.
- pooya13 9y agoI don't mean to call the OP lier but anyone knows if there is any evidence whatsoever that this video was taken on an autopilot engaged Tesla? Just want to be sure about it before I form judgment against Tesla.