8 ms·
Tesla 'self-driving' technology failed to detect a moving train ahead of a crash
- Kye 2y agoI thought it must be one of those situations where the train was around the corner and even most humans wouldn't see it unless they stopped and listened like they're supposed to. Then I watched the video. I would have missed it at that speed in the fog, but I wouldn't drive that fast in the fog. The signal is clear enough at a safe speed, but there wasn't much time to react zooming around inside a cloud.
- aurareturn 2y ago>I would have missed it at that speed in the fog Really? I wouldn't have missed. There was plenty of time for the car to stop based on the video I saw. It looks like 4 seconds of visibility before the driver had to turn the car. It didn't seem like the car was going that fast. There's no way a normal human being paying attention wouldn't be able to get the car to a full stop in that 4 seconds. From what I understand, Tesla's FSD only uses vision to drive. But we, as humans, use all of our senses to drive. We use vision, smell, sound, as well reasoning and historical knowledge. If I saw flashing lights in a fog, I would slow down no matter what. I might have heard some sounds, however faint, from the train moving. I would have reasoned that I should always drive slow in the fog, particularly near an area where there are train tracks. I might have sensed that we are driving in train track territory because I saw some tracks around here in the past or I have come across knowledge about this area before that I remembered. Tesla's FSD uses non of these senses.
- yreg 2y agoI'm not convinced Smell-O-Scope is required for FSD.
- aurareturn 2y agoThe point is that we use all our senses - however minor. If I see a crashed oil truck and there is a strong gasoline smell, I might drive as fast as possible out of the way in case it explodes or catches fire. If I smell something weird coming from the car's components, I might stop and not drive. If I smell a cow poop (such as near UC Davis), I might ready by brain for the tiny chance that a cow might escape the fence into the road. We don't just use pure vision like FSD. If FSD is only vision, then it should make up for the other senses such as sound, smell, and human reasoning with things that humans don't have such as rador/lidar.
- dzhiurgis 2y ago> strong gasoline smell > cow poop If anything, you need a modern car with HEPA filter (i.e. like most Teslas)...
- aurareturn 2y agoWell, people do open their car windows from time to time.
- enaaem 2y agoFlashing light means you have to stop according to the official rules (at least where I am from). That’s because trains can go much faster than what people think and can hit you out of nowhere.
- LaSombra 2y agoThere's also the fact that road signage alerts of train tracks well in advance to increase our awareness level to the road ahead.
- ThePhysicist 2y agoIt seems owners often post these videos to create Internet outrage in the hope Tesla will cave and pay for their totaled car. Enabling FSD in such bad weather conditions and then not being able to hit the brakes on time is mainly the fault of the operator. In the video they had at least 4 seconds to react to the situation, but for some reason they let the car speed ahead merrily.
- hristov 2y agoWhy did FSD enable itself in such bad weather conditions? Why did the FSD not hit the breaks on time, when the closed railway crossing and the train are clearly visible? Remember in the last earnings call Elon said that the latest version of FSD is almost ready for actual autonomous operation. I don't think this is the case.
- ThePhysicist 2y agoI don't say the FSD is working well, I just find it absurd how people use this technology in practice. This person knew the system had malfunctioned at the same spot before, yet they choose to enable it again under such bad conditions and then don't pay enough attention to intervene in time? Almost like the guy whose Tesla drove into a lane divider who also chose to ignore that and play on his phone even after the car had the exact same problem at the same spot multiple times. It just seems extremely reckless to me, that person would've died for sure if his car had gone under the freight train.
- penjelly 2y ago> This person knew the system had malfunctioned at the same spot before, yet they choose to enable it again they roll out new versions regularly, that's a valid excuse to try it again on a new version at "something it failed at previously". Funny how everyone assumes OTA updates will always fix problems, and never create more.
- lawn 2y ago> Remember in the last earnings call Elon said that the latest version of FSD is almost ready for actual autonomous operation. I don't think this is the case. He's been saying the same thing for a decade now.
- avar 2y agoIf online dashcam videos have taught me one thing, it's that some drivers will do almost anything to avoid an accident, other than fully depressing their brake pedal while traveling in a straight line.
- robxorb 2y agoSelection bias? Dashcam videos showing normal braking and the clear, preemptive avoidance of an accident would be the least uploaded/promoted and watched?
- rvnx 2y agoA car in the back also, if you brake, you very much take the risk of getting hit by the car in the back because these idiots are pushing in your ass :/
- stanski 2y agoIt's possible he didn't see the train in time to fully stop. Braking is important but steering to avoid something is probably the better option in most cases. It takes some distance to stop a fast traveling, heavy vehicle. Imagine seeing an accident happen directly in front of you on the highway. You better be able to steer in time cause you sure aren't stopping before hitting anything. This is also the reason to try and have both hands on the steering wheel all of the time, versus a relaxed one hand at 12 o'clock lounge while doing 70+ mph.
- hristov 2y agoYeah, for that reason I think true self driving will require lidar. You just need a system to tell you for certain that there is something in your way.
- snovv_crash 2y agoLidar is terrible in fog, it would have just fallen back and told him to drive manually. That's easy enough to do with images as well.
- defrost 2y agoRaw LIDAR, sure - there are data filters that can help reduce the bounce from water aerosols, and probably near light frequencies less affected by water. https://www.cts.umn.edu/news/2023/april/lidar https://www.cts.umn.edu/news/2023/april/lidar https://www.lslidar.com/lidar-penetrates-fog-and-empowers-safe-autonomous-driving/ https://www.lslidar.com/lidar-penetrates-fog-and-empowers-sa... But to your point any quasi autonomous driving assistance should have sanity chacking to fall back | downgrade spped and control and warn operators when sensors no longer work as expected. Just as a good human driver should know when to slow down | pull over in poor conditions.
- thebruce87m 2y ago> Doty said the car nearly hit a moving train in November after it approached some tracks after a sharp turn. > He said that the Tesla did not slow down but that he was able to stop, still hitting the crossbar and damaging his windshield. So this guy has been in a similar position before and still let the car barrel towards the train hoping it would stop this time? I don’t buy his story. The fog is an interesting situation too, as non-vision technologies would struggle here too.
- actionfromafar 2y agoRadar struggle in fog?
- IshKebab 2y agoI think he meant lidar.
- masklinn 2y agoThey do not. Lidars do though.
- pixelesque 2y agoWell, depending on the wavelength used and the MFP of the scattering elements (rain, fog droplets in this case) they do degrade a bit, but it'd be very unlikely to have a huge effect under 300 m.
- modeless 2y agoAutomotive radars struggle to detect objects which are not moving relative to the ground in the range direction. Such detections must be filtered aggressively to avoid false positives from stationary objects such as metal signs near or above the road. At the point where it crossed the road the train was moving sideways relative to the car. In the range direction it was close to stationary relative to the ground (and the crossing arm was entirely stationary, of course). So I think radar would be unlikely to save this case. If the radar was looking to the side, so it could see the train cars approaching at high speed and predict that they would enter the road, then maybe. But this seems like it would also potentially have a lot of false positives e.g. at overpasses. Perhaps for that reason, I believe automotive radars like the ones Teslas used to have generally only point toward the front. And if the train had been stopped in the crossing, as they sometimes are, the radar would be unhelpful no matter where it was pointed.
- constantcrying 2y agoThis is the reason why an autonomous car should have radar/lidar. With those sensors such a scenario would be extremely easy to detect.
- VMG 2y agoTo be fair, even the photo sensors should have been able to pick it up in this case
- bdcp 2y agoAt least pick up the CLOSED barrier.
- bell-cot 2y agoAt least for my elderly brain - in low-visibility conditions, the red flashing lights of an "active" railroad crossing signal are far more distinctive and attention-grabbing than the very thin, kinda-fog-colored gates.
- InCityDreams 2y agoI believe it to be more common in the EU to have dangly bits (metal fencing?) that hangs from the barrier to the floor. when the barrier lifts up they 'fold' vertical. This presents a proper barrier (that stops kids, cyclists, pedestrians from getting under the barrier when deployed), the 'struts' are painted red and white so they're very visible. *can't speak for absolutely everywhere, but my ride to work there are two sets of tracks I pass that have barriers that are designed to stop the stupid. Oh, I guess self-driving vehicles, too, now.
- IshKebab 2y agoI dunno if lidar would have helped here much since it was so foggy (unless fog is transparent to IR or something?). Radar would, but radar is also a bit crap - in particular angular resolution is very very poor.
- cjk2 2y agoThis can all be solved simply by driving your own car.
- JodieBenitez 2y agoOr take the train. Or the bus. It's not self-driving, but you're still not driving.
- crummy 2y agohmm no. the car keeps crashing when I do that
- cjk2 2y agoI’ve driven over a million miles without crashing into a moving train. Or a stopped train. Or even a car.
- JimDabell 2y agoWe know empirically that having humans drive cars results in many accidents, injuries, and deaths. We’ve tried many ways to solve this problem without success, and it seems reasonable to conclude that we cannot make human driving safe. It’s still early days for autonomous driving and it clearly isn’t there yet. But perhaps one day it will be. We won’t know unless we keep trying. But what we do know – with an extremely high degree of confidence – is that “just drive the car yourself” has a very large death toll. That’s not the solution to road safety you seem to think it is. The status quo is very dangerous.
- cjk2 2y agoWell define "safe". If we compare the US to the UK for example, it's considerably safer driving in the UK. Surely investment in some level of change that is causal on that level will result in more lives being saved than introducing a whole new technology arena with unknown risks? Having driven in both places, the driving standards in the US are much much worse. Perhaps we should concentrate on that first? And because not everyone will be able to afford a self-driving car utopia, perhaps it will have a greater effect. As always the technology industry perhaps is using this justification to solve the wrong end of the problem.
- yumraj 2y agoIt’s self-driving technology, not self-stopping.
- mnau 2y agoJust a reminder: Tesla also offered Full Self-Driving (FSD) as an upgrade option to EA in 2016. Here we are, 8 years later and despite flashing crossing lights and the train, it failed to detect "train crossing ahead - stop" situation. I get their probabilistic approach, but I don't see it passing the regulators.
- rvnx 2y agoPretty sure there is a shared mentality between Tesla and SpaceX: When Starship explodes: "this was a success, we learnt a lot along the way". This is the same here, yes there is an accident, but at the end this was a success because: 1) The accident didn't happen, so the safety measures worked (the "human driver"). 2) Once the fix is deployed, if you look in the long run, over 100 years, it won't happen again, so potentially hundreds of saved lives. And Tesla can claim: "Hey this is the driver's fault anyway". Main difference between SpaceX and Tesla is that it is the user paying at the end of the day.
- mcculley 2y agoSome form of success, yes. “Full Self-Driving”? No. The abuse of language is inexcusable and Tesla should be penalized for the lies.
- PinguTS 2y agoThere is another difference. One is overlooked by professionals. The other one is used by consumers with no knowledge and just trust on what was sold to them. That is the reason why other OEMs test such things with trained professionals before it is released to the general public.
- malka 2y ago> I get their probabilistic approach, but I don't see it passing the regulators. Maybe we whould apply such an approach to the question: `Should Elon Musk be in jail` ? And, as with FSD, since a single bug can cause death, I think we should roll a thousand time, and throw him in jail should a single 'yes' appear.
- tapper 2y agoAs A blind person when I first read about Tesla 'self-driving' technology I got a bit excited, now I have nightmares about it!
- poisonborz 2y agoThe time is right for Tesla to create an autonomous robotaxi fleet with this technology.
- hananova 2y agoWell it's called full self driving, not full self stopping.
- rvnx 2y agoThe emergency braking doesn't even always activate properly btw.
- whamlastxmas 2y agoThis is not true
- belter 2y agofull self stopping is an extra subscription
- resolutebat 2y agoPrevious discussion: https://news.ycombinator.com/item?id=40419760 https://news.ycombinator.com/item?id=40419760 (flagged for unclear reasons tho)
- pieter_mj 2y agoIs FSD capable of finding the path of least damage (once an accident has become inevitable) as the driver managed to do in this case? Probably not.
- falconroar 2y agoWho did Tesla have to pay off to sell a product called Full Self Driving, that is not actually fully self-driving?