8 ms·
Right. As I've pointed out previously, Tesla seems to be unable to detect sizable stationary obstacles that are partly blocking a lane, especially if they don't
by Animats 5y ago
Right. As I've pointed out previously, Tesla seems to be unable to detect sizable stationary obstacles that are partly blocking a lane, especially if they don't look like the rear end of a car. In addition to emergency vehicles, Teslas on autopilot have plowed into freeway barriers and a street sweeper. That's the usual situation for first responders, who usually try to block as little of the road as possible but often don't have enough shoulder space.
It's clear what Tesla really has - a good lane follower and cruise control that slows down for cars ahead. That's a level 2 system. That's useful, but, despite all the hype about "full self driving", it seems that's all they've got.
"Full self driving" just adds some lane-changing assistance and hints from the nav system.
- qweqwweqwe-90i 5y agoYeah, let's ignore all the good and force everyone to go back to human drivers that are 10x worse.
- clifdweller 5y agothe point isn't to ignore it but to make sure everyone using it is 100% aware they need to be paying attention as this is a edge case that is common that the system cant handle so drivers are still responsible to take over
- jacquesm 5y agoCan you please stop repeating this tripe, it's been debunked over-and-over again, and it is really getting tiring.
- evanextreme 5y agoNo one is saying this should be the case, just that the feature is not what the company advertises (the ability for the car to fully drive itself) and that said feature is further away from completion than many might lead you to believe. as someone who drives a tesla with autopilot, I agree with this. Autopilot is the best lane assistance system ive used, but thats all it is.
- breakfastduck 5y agoGo back? Human drivers are the norm, not the exception. This argument is tiresome beyond belief. But no, just keep disregarding the clearly significant issues and mis-marketing, because progress, right?
- kube-system 5y agoTesla does not offer a vehicle that does not require human drivers (not even momentarily). Tesla's autopilot and FSD systems are both SAE Level 2, which means the human is still in operation of the vehicle at all times. All of Tesla's driving assistance technologies require a human to monitor operation of the vehicle and intervene if necessary. The fact that they have given anyone an impression otherwise is problematic. https://www.sae.org/binaries/content/gallery/cm/articles/press-releases/2018/12/j3016-levels-of-automation-image.png https://www.sae.org/binaries/content/gallery/cm/articles/pre...
- ajross 5y ago> The fact that they have given anyone an impression otherwise is problematic. Good grief. This meme will not die. The car literally tells you to keep your hands on the wheel every time you engage autopilot, yells at you if you don't, will lock you out of the system as punishment if you don't comply, and if you really seem disabled will bring the car to a stop and turn the hazards on. It simply will not operate without an attentive driver, or at the very least one spending considerable energy at defeating the attention nags. There are exactly zero Tesla drivers in the world who don't know these rules. Just stop with the nonsense. Please.
- vkou 5y ago> There are exactly zero Tesla drivers in the world who don't know these rules. Just stop with the nonsense. Please. Tesla's marketing also knows that there are exactly zero drivers in the world who follow those rules, but that doesn't stop them from overselling the capabilities of what they ship.
- ajross 5y agoStop it. Please. Again, there are no Tesla drivers who have been misled about the capabilities of the system. The people who have been mislead are folks like you who read arguments on the internet and don't drive these cars. Go try one and see how the system works. It doesn't permit the kind of confusion that everyone constantly assumes. It just doesn't.
- paxys 5y agoLess than 100 first responders are hit annually in the USA. The fact that just Tesla has managed to hit 11 since 2018 makes it pretty clear that human drivers are not "10x worse" than Tesla's tech, but quite the opposite.
- qweqwweqwe-90i 5y agoYou are comparing two different things. 11 responder vehicles crashes is not comparable to how many first responders (people) are hit.
- thebruce87m 5y agoThere is no independent data to support your 10X claim. Tesla marketing or an Elon tweet doesn’t count.
- sillystuff 5y agoI was curious and went looking for corroboration / refutation of the 10x you stated. Tesla and Musk both have cited 10x safer (but I didn't see any independent confirmation). But, there was a critical analysis by Forbes that came to a different conclusion. Per Forbes, "[with autopilot] it looks like a Tesla is slightly less safe. But not a lot less safe." https://www.forbes.com/sites/bradtempleton/2020/07/28/teslas-arent-safer-on-autopilot-so-researchers-calling-for-driver-monitoring-may-be-right/ https://www.forbes.com/sites/bradtempleton/2020/07/28/teslas...
- postmeta 5y agoAs this reddit post pointed out, this appears to be a common problem with radar TACC. https://www.reddit.com/r/teslamotors/comments/p5ekci/us_agency_opens_formal_probe_into_tesla_autopilot/h95fpr9 https://www.reddit.com/r/teslamotors/comments/p5ekci/us_agen... """ These events occur typically when a vehicle is partially in a lane and radar has to ignore a stationary object. This is pretty standard and inherent with TACC + radar. The faster Tesla pushes the vision only stack to all cars after they’ve validated the data, the faster this topic becomes moot. Andrej Karpathy talks and shows examples of what that would do here. Minutes 23:00-28:00 https://youtu.be/a510m7s_SVI https://youtu.be/a510m7s_SVI Older examples from manuals of other TACC systems which use radar: Volvo’s Pilot Assist regarding AEB/TACC. According to Wired, Volvo’s Pilot Assist system is much the same. The vehicles’ manual explains that not only will the car fail to brake for a sudden stationary object, it may actually race toward it to regain its set speed: “Pilot Assist will ignore the stationary vehicle and instead accelerate to the stored speed. The driver must then intervene and apply the brakes.” Cadillac Super Cruise - Page 252 Stationary or Very Slow-Moving Objects ACC may not detect and react to stopped or slow-moving vehicles ahead of you. For example, the system may not brake for a vehicle it has never detected moving. This can occur in stop-and-go traffic or when a vehicle suddenly appears due to a vehicle ahead changing lanes. Your vehicle may not stop and could cause a crash. Use caution when using ACC. Your complete attention is always required while driving and you should be ready to take action and apply the brakes. BMW Driving Assistant Plus - Page 124 A warning may not be issued when approaching a stationary or very slow-moving obstacle. You must react yourself; otherwise, there is the danger of an accident occurring. If a vehicle ahead of you unexpectedly moves into another lane from behind a stopped vehicle, you yourself must react, as the system does not react to stopped vehicles. """
- sjg007 5y agoWhat about Subaru eyesight? I thought it did..
- Loughla 5y agoSubaru's eyesight absolutely will stop you when you think you're about to hit something, regardless of whether or not that something was moving previously. It's actually really annoying if you live in a rural area without clearly defined lanes, and large, stationary objects (tractors and whatnot) close to the road.
- icelandicmoss 5y agoI feel like part of the problem with the kind of autopilot crashes you describe here is how inexplicable they are to humans. Whilst humans can be dangerous drivers, the incidents they cause generally have a narrative sequence of events that are comprehensible to us -- for instance, driver was distracted, or visibility was poor. But when a supposedly 'all-seeing always watching' autopilot drives straight into a large stationary object in clear daylight, we have no understanding of how the situation occurred. This I think has a couple of effects: 1) The apparent randomness makes the idea of these crashes a lot more scary -- psychologically we seem to have a greater aversion to danger we can't predict, and we can't tell ourselves the 'ah but that wouldn't happen to me' story. 2) Predictability of road incidents actually is a relevant piece of information. As a road user (including pedestrian), most of my actions are taken on the basis of what I am expecting to happen next, and my model for this is how humans drive (and walk). Automated drivers have different characteristics and failure modes, and that makes them an interaction problem for me.
- kevin_thibedeau 5y agoIt's perfectly explainable. You have a blind machine with an imperfect sensorium trying to describe an elephant. Correct identification is just getting lucky. The layers of ML improve the odds but can never achieve 100%. The whole scheme is playing dice with other people's safety.
- oaw-bct-ar-bamf 5y agoIn my opinion the underlying assumption autopilots are built with are wrong. It is assumed that the road is free to drive on. Only when the vehicle computer detects a known object on the road that it knows should not be there it is applying brakes or trying to steer around. I would feel safer if the algorithm would assume the negative case as default and only give the „green light“ once it determined that the road is free to drive on. In case of unknown (not yet supervised) road obstructions the worst needs to be assumed. That’s where the ‚unexplainable‘ crashes are coming from. Something the size of an actual truck is obstructing the road. But couldn’t quite classify it because the truck has tipped over and is lying on the road sideways. Not yet learned by the algorithm. Can't be that bad, green light, no need to avoid or brake.
- bit_logic 5y agoI think we need to add a new level 2 assisted driving skills section to driving tests. Level 2 can be safer but it really requires understanding how level 2 works and limitations. For example, when I use level 2 (mine is Honda but applies to other level 2 as well since they mostly share the same vendor), these are the rules I follow: - Car switching in/out of my lane, I manually take over - Tight curve in the freeway, manually take over - Very frequently check the dashboard indicator that shows if the sensors "sees" the car front or not - Anything unusual like construction, cones, car on shoulder, manually take over - Anything that looks difficult like weird merging lanes, manually take over - Any bad weather or condition like sun directly in front, manual drive - Frequently adjusting max speed setting on ACC. It's safer to not be too much above the prevailing speeds. Otherwise, if ACC suddenly becomes blind, it can accelerate dangerously as it tries to reach max set speed. - I don't trust lane keep much, it's mostly a backup for my own steering and making my arms less tired turning the wheel The key thing is to recognize just how dumb this technology is. It's not smart, it's not AI. It's just a bit above the old cruise control. With that mindset it can be used safely.
- tayo42 5y agoSeems like it's easier just to drive regularly. This sounds very distracted
- mmcconnell1618 5y agoI wonder if some sort of standard display showing what the vehicle "sees" and is predicted to do will be regulated. For example, if the display shows the vehicle doesn't understand a firetruck parked half way in the lane or the tight curve on the freeway, at least the driver can validate on the display and have some time to react.
- sunshineforever 5y agoI would strongly prefer a car with such features.
- ajross 5y ago> Level 2 can be safer but [...] I think that requires more numerate analysis than you're giving though. The data from the story is a sample size of 11 crashes over three years (I think). If that's really the size of the effect, then your "but [...]" clause seems very suspect. There are almost two million of these cars on the roads now. It seems extremely likely that the number of accidents prevented by AP dwarfs this effect, so arguing against it even by implication as you do here seems likely to be doing more harm than good. That doesn't mean it's not worth investigating what seems like an identifiable edge case in the AP obstacle detection. But that's a bug fix, not an argument about "Level 2 Autonomy" in general.
- asdff 5y agoI don't understand how its even possible for these cars to be crashing. My car beeps like a missile is locked on when I am coming too close to an object I might hit. Just a simple sensor in the front. If my car can beep and give me enough time to slam on the brakes, why can't Tesla's do the same?
- quartesixte 5y agoWell for starters, they’re taking out the radars that other cars rely on to accomplish this.
- shrimpx 5y agoIn other parts of this thread, people are suggesting that these crashes are the radar's fault and deploying their vision-only system will fix the problem.
- jazzyjackson 5y agoI don’t see how you can blame a radar for your vision system not being able to classify a fire truck (not to mention the unforgivable act of ignoring objects it can’t classify)
- quartesixte 5y agoAs the sibling post says, that’s ridiculous at face value. All the radar is check for collisions because that’s how a radar works...is there a non-intuitive answer here???
- shrimpx 5y agoHere's a comment: https://news.ycombinator.com/item?id=28198933 https://news.ycombinator.com/item?id=28198933
- HALtheWise 5y agoYou're probably referring to parking sensors, which are typically ultrasonic sensors mounted to the bumpers. Unfortunately, ultrasonics have both a limited range of ~20ft for practical uses, and more damningly, a relatively wide field of view with no ability to distinguish where in the field of view an object is. While 20ft range is more than enough to give you time to slam on the brakes in your garage, it's basically useless for high speed autonomy, except for some very limited blindspot-awareness type tasks.
- shrimpx 5y agoElon keeps warning the world about the impending hyperintelligent AI that will retool human economies, politics, and religions, yet year after year his cobbled-together AI fails at basic object detection.
- president 5y agoIt's all marketing and image projection.
- geekraver 5y agoAI is a bogus term. It was well-discredited in the 1980s and has gone through an ill-deserved rehabilitation. Deep neural nets are a step forward for some tasks like vision, but are still just scratching the surface of what really goes on in our brains when sense-making from visual data.
- MisterTea 5y agoI'm split over this. On one hand The AI is so incompetent that it could never take over the world and enslave humanity. On the other, its so incompetent that it winds up killing humans anyway. lose-lose.
- RcouF1uZ4gsC 5y ago> That's the usual situation for first responders, who usually try to block as little of the road as possible but often don't have enough shoulder space. Actually, from talking with friends who are first responders, many times they will park fire trucks, etc so that they are blocking enough of the road to protect the first responders and the victims. The last thing you want is to have another car come and crash into first responders or victims of the initial accident. That is why they will deliberately park the truck at an angle to protect the people.
- FireBeyond 5y agoExactly this. We'll place the heaviest apparatus 'upstream' of the event and in a way that 'encourages' cars away from the incident. Larger departments or those dealing with busier freeways have even started re-purposing older engines with water ballasts and attenuators as 'blocker' engines.
- didntknowya 5y agoit'd say it's more just a fancy cruise control with obstacle detection than a true "self driving" system