7 ms·
Tesla on autopilot crashes into stopped Michigan police car
- rolph 6y agoi hope they keep that bug locked down. if that was weaponized there would be an issue for sure.
- Animats 6y agoIt's the usual Tesla bug - plowing into a stationary vehicle partly blocking a lane. Just like the fire truck, the street sweeper, the stalled car...
- Traster 6y agoAt what point does that become criminal negligence?
- trhway 6y agoit seems we're living at the golden age of autonomous driving development as even Uber killing a woman due to disabled emergency braking didn't make it even to the negligence (granted Uber showing poor dynamic range video recorded by what seems like a cheap cell phone camera to the sheriff in that village (Phoenix) also played the trick - that sheriff can be fooled by such a video is the major part of why it is the golden age right now). The same way with Tesla - notwithstanding me being a big fan of Musk - self-driving without 3d scene building is pure arrogance and negligence which is enabled only by general public and government not-understanding of the things - thus the golden age.
- toomuchtodo 6y agoFunny enough, it happens with human drivers too. Perhaps the fix is to block the entire lane instead of partially blocking it. At least the Tesla will stop for such a scenario, where a human still might not. Can't be that expensive to roll an additional rescue vehicle to sit in the lane with their lights on (I see it quite often in Florida, unsure about other states). > According to recent data taken from the AAA Foundation for Traffic Safety, approximately 12 percent of all interstate highway deaths result from shoulder accidents. This means that an estimated 600 people a year are killed—and thousands more are injured—while making emergency stops off the highway. https://aaafoundation.org/wp-content/uploads/2017/12/PedestrianFatalitiesonInterstatesReport.pdf https://aaafoundation.org/wp-content/uploads/2017/12/Pedestr... It's unfortunately fairly difficult to find stats on accidents scoped solely to vehicles rear ending emergency vehicles partially obstructing a travel lane. The stat I present is a proxy.
- throwaway0a5e 6y agoRunning into the back of a police cruiser that's partly in the lane with lights on is something humans generally only do before blowing a .1x on the breathalyzer. The link you posted shows a clear correlation between low light conditions and hitting people on the shoulder. A police cruiser has blue lights and presumable the federally mandated reflective surfaces that all vehicles sold in the US have (usually in the tail lights). This is a typical case of software making stupid mistakes a human would never make.
- toomuchtodo 6y agoIt's a fairly common problem even without being under the influence. > Distracted driving is dangerous, claiming 3,142 lives in 2019. https://www.nhtsa.gov/risky-driving/distracted-driving https://www.nhtsa.gov/risky-driving/distracted-driving > The National Safety Council reports that cell phone use while driving leads to 1.6 million crashes each year. Nearly 390,000 injuries occur each year from accidents caused by texting while driving. 1 out of every 4 car accidents in the United States is caused by texting and driving. https://www.nsc.org/road-safety/safety-topics/distracted-driving https://www.nsc.org/road-safety/safety-topics/distracted-dri...
- throwaway0a5e 6y agoYour statistics are for human drivers hitting cars and people. Not objects with blue lights (intentionally designed to be highly visible) that can be seen for miles at night being hit by vehicles that are augmented with computers that don't get distracted. Stop being intentionally misleading. An always-on computer hitting a police cruiser (the rear end of which conforms to known standards regarding number, position and size of reflective surfaces) is nowhere near equivalent to someone hitting something because they were looking at their phone. Is it too much to expect technology to at least avoid the kind of accidents only incapacitated humans have?
- Aeronwen 6y agoThose lights are blinding as hell at night. The only reason a person wouldn't have hit the car is because it's the only thing you can see when trying to pass one.
- gpm 6y agoIt's the usual AI bug, crashing on a rare edge case (i.e. not well represented in the training data) that seems straightforward logically to a human, leading to us being surprised/shocked/horrified that the AI missed the issue. The most interesting part of this, is that this is a case that humans screw up on a pretty regular basis too. However we understand the human reason for doing so (lack of concentration), and understand that AIs don't suffer from the same fault. So when an AI screws it up we are still surprised.
- shagie 6y agoThe issue is that the AI will do the exact same thing each time it is presented with the same data (crash) whereas a human could go to remedial driver's education. And taking away the license of one inattentive driver gets them (theoretically) off the road... whereas if you have an AI crash into a fire truck and you said "stop it" - you still have all the other identical deployments out there with the same flaw. And "add some partial blockage by a vehicle in the lane, retrain the AI, and then redeploy it" isn't a proper answer... wouldn't that be a different model AI that would need to be validated again?
- deleted 6y ago[deleted]
- gpm 6y agoYou can turn this around though. It's harder to teach the AI, sure. But once you've taught it, it stays taught. With humans you have to deal with the continually renewing stream of young people who are new to driving. > And "add some partial blockage by a vehicle in the lane, retrain the AI, and then redeploy it" isn't a proper answer... wouldn't that be a different model AI that would need to be validated again? You're the one adding unnecessary constraints here. If the validation process harms more than helps, you don't do it. In all likelyhood the correct validation process is something lightweight that can be done quickly for simple changes. This sort of training process is likely to be a continuous process, they're always ingesting new data, trying to learn how to drive better from it (and keep up with how patterns in the world change), and therefore continually deploying new models. Because that makes driving safer overall. Not a "this bad thing happened so let's figure out how to put out a bugfix for it".
- hartator 6y ago> driving with a suspended license Well, one can argue that someone willing to drive after his license is revoked is also willing to lie about the Tesla crashing itself. It seems super reasonable to wait for Tesla side instead of rushing to conclusions.
- Imnimo 6y agoIf you've got a suspended license, better to let the car drive itself! /s
- ronsor 6y agoI wouldn't be surprised if the driver unironically believed that.
- oblio 6y agoI imagine it's even more reasonable to wait for the conclusion of a legal authority, not that of a directly involved party.
- beckman466 6y agoCapitalist firms be starting countries these days. https://apnews.com/article/legislature-legislation-local-governments-nevada-economy-2fa79128a7bf41073c1e9102e8a0e5f0 https://apnews.com/article/legislature-legislation-local-gov...
- oblio 6y agohttps://en.wikipedia.org/wiki/Dutch_East_India_Company https://en.wikipedia.org/wiki/Dutch_East_India_Company Highlights: > The company, for nearly 200 years of its existence (1602–1800), had effectively transformed itself from a corporate entity into a state or an empire in its own right. > With its pioneering institutional innovations and powerful roles in world history, the company is considered by many to be the first major, first modern, first global, most valuable, and most influential corporation ever seen.
- Jyaif 6y ago> The driver of the Tesla [...] was ticketed for failing to move over and driving with a suspended license. It could be argued that technically he wasn't driving.
- grecy 6y agoAs the laws exist today, it's very, very clear you are legally driving when using any driver-aid technology.
- jedimastert 6y agoHe was responsible for the operation of the vehicle. I believe the legal definition is who's in the driver seat while the car is on
- Arnt 6y agoLift your hands from the wheel, close your eyes, drive into something and afterwards say you weren't driving. Well, you weren't.
- xiphias2 6y ago,,The driver of the Tesla, identified as a 22-year-old man from Lansing, was ticketed for failing to move over and driving with a suspended license.'' I suggest a better headline: a 22-year old man with a suspended license crashes into stopped Michigan police car.
- danso 6y agoNo, the apparent fact that the car was in Autopilot is what makes this interesting. Autopilot is touted as being effective – if not more effective than human operators – in avoiding this kind of accident.
- andrewmunsell 6y agoNo where is it advertised that autopilot handles partial lane obstructions or debris in the road, certainly better than a human. Regardless what your opinion is on the naming, autopilot is a form of cruise control and legally and operationally requires driver attention, 100% of the time.
- Judgmentality 6y ago> No where is it advertised that autopilot handles partial lane obstructions or debris in the road, certainly better than a human. I'd say the CEO advertises it otherwise. https://www.wired.com/story/elon-musk-tesla-autopilot-60-minutes-interview/ https://www.wired.com/story/elon-musk-tesla-autopilot-60-min...
- andrewmunsell 6y agoElon says a lot of things he shouldn't, but the user accepts a very clear disclaimer before enabling Autopilot: https://www.tesla.com/sites/default/files/images/autosteer-enable-s-x.jpg https://www.tesla.com/sites/default/files/images/autosteer-e...
- mike_d 6y ago
- 762236 6y agoIt is possible for third parties to setup experiments that demonstrate the limits of Tesla's (or any car's) obstacle detection. When you are an expert in the field (such as vision), you can guess the limits, and setup an experiment (e.g., a white sheet hanging across the road).
- Animats 6y agoTop Gear did something like that. They got a big inflatable that looks like a car, set it on an old airport runway, and drove at it in various vehicle with auto-brake.
- dt3ft 6y agoTime to ditch the term “autopilot”, eh?
- rowanG077 6y agoWhy? Seems like the perfect term. It's stolen from aerospace where pilots still not to be aware when autopilot is engaged.
- sschueller 6y agoOr how Boeing thinks it should operate.
- rowanG077 6y agoNo. The term is quite clear on this. https://en.wikipedia.org/wiki/Autopilot https://en.wikipedia.org/wiki/Autopilot > Autopilots do not replace human operators. Instead, the autopilot assists the operator's control of the vehicle, allowing the operator to focus on broader aspects of operations (for example, monitoring the trajectory, weather and on-board systems).
- josefx 6y agoSo it "only" encourages its users to take their eyes of the road for extended periods of time? I am sure the police will love to hear "I was just checking google maps for directions, but I had autopilot enabled so it is fine" after a crash.
- rowanG077 6y agoIt doesn't matter what it encourages. It matters what the contract between the person using the car and the car is. The contract is quite clear. The term is clear. There really should be no issue. I really don't get why people are so salty about this. When you are piloting a vehicle it should be razor sharp that you are holding a weapon in your hand that is deadlier then a handgun.
- yawaworht1978 6y agoThe bright side of this "little" incident is, they did not have to call the police to report the incident.
- falcolas 6y agoI'm sure the police in this case called for another car. Humorous idea, though.
- geocrasher 6y ago> Critics say the name [Autopilot] misrepresents the driver-assist system's capabilities. I can't disagree. Autopilot in a car should mean the same as it does in "Airplane!" or "Wall-E". > The driver of the Tesla, identified as a 22-year-old man from Lansing, was ticketed for failing to move over and driving with a suspended license. And there's the actual problem. You can blame Tesla all you want, but you'll have a hard time proving that the brand/model/features of car this person chose to drove has anything to do with the crash.
- intuitionist 6y agoThe only bag of air I want inflating into my driver’s seat is the airbag, and then only if it’s reasonably likely to save me from death or dismemberment
- dragontamer 6y ago> Autopilot in a car should mean the same as it does in "Airplane!" Shirley, you should keep your jokes PG! Wait, Airplane is PG? Oh man, the 80s were a different time... An "Airplane! autopilot" requires... services... to operate. That was apparently PG in the 80s but not PG in today's society!
- VBprogrammer 6y agoI think you are completely correct that what autopilot means in the public consciousness is much more than what it can actually do. The funny thing is that what an autopilot does in a real airplane is actually pretty close to what the Tesla autopilot does, if you set it to fly you into a mountain it will happily do so (abet with a lot of alarms going off in a modern airliner).
- falcolas 6y agoNot for decades now. Sure, a basic private aircraft wing-leveler or heading keeping system will fly you into a mountain, but the autopilots in passenger airlines can take off, fly a complete course, and land the plane. They're monitored by trained professionals with thousands of paid hours and hundreds of hours of training, of course.
- Nailgun 6y agoWhat's with that 60 second "processing cookie" stuff?
- GNU_James 6y agobased?
- xoa 6y agoI think the stubborn refusal to make use of LIDAR and other advanced sensors along with the idiotic claim that "humans can do fine with two eyes so so can we" will go down as one of the most genuinely foolish and bullheaded moves by Elon Musk. Having unavoidable surprises and accidents in the development of something like self-driving is understandable, and ultimately a few such things are frankly acceptable losses if the rate of tens of thousands of annual deaths by humans is cut. But they should be unavoidable and surprises, and there should be failsafes to try to avoid the worst. Driving into an object at full speed is obviously the most fundamental Bad Thing, Don't Do That in driving. Having a system that can cut into the more complex autopilot and at least slam the breaks every single time, even at worst within a short range where it's too late to avoid but can at least greatly minimize impact energy, should have been a day 01 foundational safety measure before embarking upon the rest. Huge point of self-driving should be being better than humans are. They should have FLIRs to deal with both moose and dark pedestrians at night, LIDAR/terahertz/ultrasonics, 360° cameras, whatever is needed to not just meet but actively avoid all kinds of crashes humans have. I hope Tesla really does get a bit slammed for cheaping out and then refusing to do a mea culpa on it, it's just so dumb.
- smilekzs 6y agoWell in a traditional frontal collision avoidance system you rely on the very same mmwave radars and cameras (even a stereo pair in the Subaru system). Yes, L4+ self driving needs more for performance. A Tesla has more sensors than normal FCA/LKA system implementations; so IMHO the blame in this specific case is more likely with software than hardware.
- xoa 6y agoEven amongst traditional manufacturers, Ford, Nissan, and Volvo have all opted for use of lasers along with mmWave. Volkswagon also has laser sensors on at least some models. And normal CAS are merely final emergency backups to normal involved human driver. They're added systems to help cover gaps in attention, and many simply depend on alerting the driver, not even doing breaking on their own. Whereas Tesla has been marketing autopilot as on the path to full level 5 since the beginning right down to the branding (vs "advanced driver assistance" or something), and whatever asterisks they've added since drivers keep depending on autopilot and autopilot vehicles keep crashing into stationary objects. Sure, maybe better software could avoid that, but the fact on the ground is that it hasn't. And for a life safety critical system, throwing hardware at a problem vs pure software is not wrong just because it's more expensive. Tesla may be trying to optimize costs and be aggressive as they have been in other areas, doing the whole MVP/iteration thing, but this is one place where that just isn't necessarily the greatest strategy. They should be aiming to be better than human drivers not just as-good-as, and the challenges and limitations of ultra complex software based systems development are hardly some new revelation. They should have been prepared for that too with more hardware backstop.
- GNU_James 6y agoThis website can't display content with javascript disabled. Screw them.
- pengaru 6y agoTSLA is a meme stock fake it til you make it
- stunt 6y agoThis isn't the first time, right? Last one was a stopped truck somewhere in Europe. We built a fancy computer vision model to detect and track football and it turns out a bald referee in a sunny weather can trick our model to think his head is the ball. So I wouldn't be surprised to know there are some flaws in their models too. It's way safer to have other sensors and don't rely only on cameras if the purpose is engaged autopilot that takes control from the driver away.