7 ms·
Didn't even slow down. Humans often brake late, but seldom fail to brake at all. It's grossly irresponsible of Tesla to ship a system that can't detect big, so
by Animats 6y ago
Didn't even slow down. Humans often brake late, but seldom fail to brake at all.
It's grossly irresponsible of Tesla to ship a system that can't detect big, solid obstacles. This happens over and over.
So far, they've hit a crossing semitrailer, a street sweeper, a car at the side of the road, a fire truck at the side of the road, and two road barriers. This has been going on for five years now, despite better radars and LIDARs.
- sgt 6y agoDoesn't this take us back to the discussion around the word Autopilot? Tesla sells it as driver-assist, no more autonomous than an autopilot system in a Boeing 737. Good for following the obvious path, and otherwise needs input from the actual pilot.
- c22 6y agoIt seems like the obvious path would be around solid obstacles. I've never driven a Boeing 737, but will the autopilot really fly you directly into an obstacle with no warning at all? My understanding was that these vehicles are equipped with radar and collision avoidance systems.
- floatingatoll 6y agoGenerally, non-military aircraft avoid collisions using radio broadcasts from various beacons (their own and those of other planes). Actual radar systems for detecting non-broadcasting obstacles are, per Wikipedia, generally only found on military aircraft. So if you define "an obstacle" as something that is not a plane broadcasting a beacon, then, yes, a Boeing 737 would probably run directly into it if it were somehow in the path of the autopilot.
- s_y_n_t_a_x 6y agoYes it will, autopilot just keeps the heading and the altitude. There may be other sensors onboard that help with detections (it is a lot more expensive after-all) but the autopilot control system does no such thing. Even with all the sensors onboard, the 747 would most likely run into something without assistance, in fact I've seen a few cases of this on Air Disasters.
- SiempreViernes 6y agoYeah, probably. The use case is keeping the plane stable in a big empty space. I don't think civilian air planes have any collision avoidance radar, because as late as 2006 we get mid air collisions like this: https://en.wikipedia.org/wiki/Gol_Transportes_A%C3%A9reos_Flight_1907 https://en.wikipedia.org/wiki/Gol_Transportes_A%C3%A9reos_Fl...
- netsharc 6y agoThe planes don't use radar but rely on transponder data and have TCAS (https://en.wikipedia.org/wiki/Traffic_collision_avoidance_system https://en.wikipedia.org/wiki/Traffic_collision_avoidance_sy...) that would coordinate with each other, and yell at one plane's pilot to go up and the other's to go down. In that accident the smaller plane had its transponder switched off. A passenger on the smaller plane (which had zero casualties) wrote about it from his point of view: https://www.nytimes.com/2006/10/03/business/03road.html https://www.nytimes.com/2006/10/03/business/03road.html
- rsynnott 6y agoSome Airbus planes have them, but I think it’s an optional extra.
- mark-r 6y agoI once saw a near miss of 2 civilian planes. One was taking off from an airport next to Lake Superior, and the other was a float plane taking off from the adjacent bay. I only noticed because I heard the engines rev up as they took evasive maneuvers.
- Someone 6y agoThe autopilot will, but many airplanes do have separate systems for collision avoidance (https://en.wikipedia.org/wiki/Airborne_collision_avoidance_system https://en.wikipedia.org/wiki/Airborne_collision_avoidance_s...)
- serf 6y agoAviation auto-pilot will most definitely fly you into things. Systems exist which will override auto-pilot in the event of such happenings, like Auto-GCAS (ground collision avoidance systems) and equivalents, but these aren't really designed for sudden obstructions -- they are mostly designed to help regain level flight if a pilot becomes unresponsive during maneuvers and is pointed in A Bad Way -- but auto-pilot is not going to be engaged during such flight, anyway. But systems like this do have authority to disengage whatever other systems that may interfere with their operation, like auto-pilot. There are many onboard systems to allow awareness of such conditions that will result in collision, but not much in control of actual flight characteristics on any but the most advanced or experimental planes.
- Someone 6y agoThey have backpedalled a bit, but https://www.tesla.com/model3 https://www.tesla.com/model3: “Autopilot enables your car to steer, accelerate and brake automatically within its lane“ to me, seems to apply to this event. To me, it also looks as if it almost hit a person, too (the driver of the van?)
- AlexandrB 6y ago> To me, it also looks as if it almost hit a person, too (the driver of the van?) You’re right, I hadn’t noticed that! That’s even worse. Seeing a person on the side of the road is not that uncommon and is a near-certain fatality if a collision occurs.
- detaro 6y agoAirliners have the large benefit that solid obstacles don't tend to suddenly appear in their flight paths (and the most likely candidate, other planes, is being kept away by ATC and failing that warned about by transponder systems), so the cruise-altitude "follows the obvious path" is a lot more useful. That doesn't protect against operator errors of various kinds (set course into a mountain, didn't realize the autopilot was disengaged, ...), but is a large difference from streets. Even in planes pilots taking over when automation encounters a situation it can't handle is a risk due to potential confusion about the current situation, and on streets the reaction times necessarily to react to an autopilot failure are typically way shorter.
- tenpies 6y agoIf only we had a regulatory agency that monitored this sort of stuff and then punished companies that used exploitative language to dangerously market their products as something they are not.
- wcoenen 6y ago> Didn't even slow down. The car in the video does seem to be braking strongly 1 second before the collision. There's a cloud emanating from the wheels. > Humans often brake late, but seldom fail to brake at all. Humans do fail to brake completely, e.g. when they fall asleep or have their eyes on their phone.
- deleted 6y ago[deleted]
- deleted 6y ago[deleted]
- ACow_Adonis 6y agoLooked to me like that might have been due to the pedestrian (driver?) in close proximity adjacent to the car at that point. Puffs past him and then straight into the side of the truck.
- mark-r 6y agoSo that brings up the question, was the car AI too focused on the pedestrian to notice the truck?
- dragontamer 6y agohttps://www.youtube.com/watch?v=LfmAG4dk-rU&t=46 https://www.youtube.com/watch?v=LfmAG4dk-rU&t=46 There are no brake lights on the Model 3. None at all. Based on this "reverse video", my conclusion is that the M3 doesn't even brake. ------- Somewhat worrying is the pedestrian (the truck driver?) who jumps back to get out of the way of the M3. Not only did the M3 miss the truck, but the M3 didn't seem to see the pedestrian either.
- globular-toast 6y agoEven the driver behind the Tesla seems to slam on the brakes at the last minute, lose control of the vehicle and then dangerously swerve across two lanes to pass the obstacle. What on earth is going on with these road users? I'd expect a very slow approach, hazard lights on, stop and check that everyone is OK before even thinking about continuing around the wreckage.
- jeffreygoesto 6y agoTesla only uses Cameras (trained for "normal appearance" of cars, that is front and back views) and Radar (notoriously high false positive rate for standstill targets aka clutter, they need to be suppressed to be driving without hard braking every now and then), no Lidar. This overturned truck would have been difficult to incorporate into a training set for semantic labeling if you want to have a safe reaction for all kinds of unusual objects together with a reasonable false positive rate. Similar classification failures in all those cases. Can't be solved reliably with just vision and Radar.
- aquadrop 6y agoCan't radar and cameras augment each other and help to solve false positives? I just don't understand, it's pretty simple thing to notice, humans can solve it with vision only. It doesn't need to label what it is exactly, it just needs to understand that there's something, and it's probably not a good idea to plow in it full speed. I'm very positive about what Tesla is doing overall but this issue seems to be unresolved for years, and the way they handle these cases information-wise is also bad.
- SiempreViernes 6y agoYou can read the article, and see the video yourself, and the answer is no: Tesla couldn't manage reliable detection of "big object blocking the way".
- serf 6y agoyeah, but Tesla being unable to do it doesn't mean that someone can't. It's a hard problem, but a system with more sensory inputs than the human optical system shouldn't solve the same problem worse -- this points to a real issue in the problem solving methodology, but doesn't do much to condemn the idea of camera/radar fusion. Now, if the question was "Can Tesla do this reliably?" -- different answer.
- TaylorAlexander 6y ago
- spuz 6y ago> It's grossly irresponsible of Tesla to ship a system that can't detect big, solid obstacles. I think this is a case of something that seems grossly irresponsible because it's a task that humans can do extremely easily. Clearly, if LIDAR cost nothing then Tesla would happily use it in their cars. The reality is that a technology that can perform as well as a human at static object detection is cost prohibitive which is why you don't see it in any mass market vehicles. I would imagine in some cases a human driver i.e. a taxi still costs less than LIDAR. So it becomes a question of how responsible should we make Tesla for the expectations that some of their customers may have when they release any kind of driver assistant technology? You can argue both ways that it would be irresponsible of them to release the technology that they have now without guaranteeing that every driver will fully understand its limits but also that it would be irresponsible of them not to release such technology given the number of lives it can save in its current form.
- michaelmrose 6y agoPresumably it would cost even less not to include this feature at all. I think a reasonable question is if this feature avoids more collisions in more average conditions or causes more in extraordinary ones. Even if it saves more than it costs it might cost more in pr and court costs than is earned from selling the feature. It is probably impractical to sell something that saves 2 people that we cannot innumerate or name if it kills one person with a name, address, next of kin, and lawyer.
- screye 6y agoThis is exactly why we need LIDAR. Tesla has been very stubborn about avoiding LIDAR and this is what happens as a consequence. The rest of the self-driving scene fundamentally relies on LIDAR to get things working. Believe me, if cameras were sufficient people wouldn't use LIDAR . LIDAR is expensive. I have spoken to quite a few people in the field and the lack of LIDAR in Tesla vehicles baffles them. Radar is not a substitute for LIDAR. Sound is really high latency and has terrible resolution. I would like to see how often things like these happen with Waymo.
- Cerium 6y agoRadar is not sonar. The latency for radar is good, but the resolution is indeed poor.
- throwaway0a5e 6y agoIf you're willing to spend DOD type bucks you can get some insanely good (like the old boring legacy tech will keep track of a city's worth of vehicles and dismounts without getting them all confused with each other) radar. The secret sauce is in the algorithms though and lord knows how many millions of dollars and man hours have been poured into that.
- mlyle 6y agoLimited aperture on a car means limited angular resolution even with millimeter wave. This can mean the information needed to tell whether something stationary is in your path just isn't there-- especially in the vertical direction where aperture is smaller. A big flat surface that's not normal to you like the box truck may also not be a very large return.
- kube-system 6y agoYeah, my 6 year old Toyota has millimeter wave radar, and so do a lot of cars, for detecting objects in front of the vehicle.
- jturpin 6y ago
- tenpies 6y agoAlso interestingly: AEB did not trigger. It's not the first case I've seen where Tesla's Autopilot seems to override AEB[1]. Definitely confirmed behaviour to-date and seen as early as Q1 of this year. Any car from 2009 or later with AEB would have avoided this collision. It probably would be great if car software didn't follow the "move fast and break things" mantra. --- [1] https://www.consumerreports.org/car-safety/automatic-emergency-braking-guide/ https://www.consumerreports.org/car-safety/automatic-emergen...
- Reason077 6y ago> "Also interestingly: AEB did not trigger." Looking at the video, a bunch of dust seems to be kicked up around 1.5 seconds before the impact, suggesting hard braking. Clearly it activated too late to avoid the collision, but it certainly would have reduced the energy of the impact, and thus potential injury to occupants.
- lutorm 6y agoI don't think that's true. As far as I know, typical AEB systems are radar-based and can't determine what's on or off the road, so they rely on Doppler to pick out the car in front from the environment. If you're driving up towards a completely stationary object, it will have a very hard time detecting it.
- Reason077 6y agoModern AEB systems use cameras in addition to radar, and some are actually camera-only. Besides stationary obstacles, you need a camera to detect pedestrians, cyclists, etc.
- kube-system 6y agoThis is instantly noticeable if you drive a vehicle with radar cruise. It won't slow down if you're pointed at a stationary object.
- kalleboo 6y agoWhen we bought our used car, we were deciding between a slightly newer model and a slightly older model, and one of the differences was the older model used stereo vision for AEB and the newer model used radar. Even the car salesman said that the stereo vision worked better (as it detects stationary objects). I wonder why the move to radar. Is it cheaper?
- movedx 6y ago> This happens over and over. So far, they've hit a crossing semitrailer, a street sweeper, a car at the side of the road, a fire truck at the side of the road, and two road barriers. This has been going on for five years now, despite better radars and LIDARs. And in that time, how many people have crashed into other people, whether they're in cars or not? Buildings? Walls? Children? Are you claiming that Tesla's safety performance is worse than that of people?
- phs318u 6y agoThe answer would depend on no. of incidents per km driven. Apples to apples.
- bsaul 6y agoMan, this kind of arguments is getting tiring... It is obvious that 100% of human in the OP situation having no particular medical condition would perform better than tesla autopilot. Tesla’s autopilot doesn’t fail because of malfunctions such as short-circuits or bad weather conditions, or anything special happening (as opposed to humans), it fails under perfectly normal condition. You can’t even start to compare autopilot safety performance to people performance unless you work for tesla’s marketing, for the simple reason that no human is in theory authorized to let that thing drive itself without supervision. What you’re comparing is human + autopilot vs only human. What seems extraordinary, is that human+autopilot actually performs worse than just humans in some conditions, such as OP, simply because of the way autopilot was advertized.
- atgprime 6y agoThere's a very simple fix, which is to have a human driving and allow autopilot to work only in an emergency, when it detects the car is about to crash. Then you get all of the touted safety advantages, and none of the bizarre accidents.
- bsaul 6y agounfortunately i don't think detecting potential crash is that easy ( and i think it's part of the original problem). eg in OP. There could also be other situation where autopilot think there's a problem when there's none.
- m463 6y agoIt's pretty irresponsible to put a 16-year old behind the wheel, but we do it every day. We just put another driver in there to check things. In the same way, what I think is: driver - pretty safe autopilot - pretty safe driver + autopilot - safest
- mark-r 6y agoThat's absolutely wrong. A driver without assist will be fully engaged, while with assist they'll be tempted to divert their attention. Once attention is diverted they're no better than autopilot on its own.
- m463 6y agoa teenager will do the exact same thing.
- mark-r 6y agoSo a teenager is more likely to get in an accident than the average driver. I think the insurance companies have been aware of that forever. My point is that while driver+autopilot is claimed to be the safest option, I contend that it is less safe than driver only. At least at the current state of technology, and even including teens.
- maxdo 6y agoit did emergency brakes,that's why the person remains alive and totally unharmed.
- xvector 6y agoNo, the driver applied the brakes