4 ms·
We don't even know if the autopilot was on in this case. And lots of self-driving systems are designed to ignore stationary objects at highway speeds, because
by sp332 8y ago
We don't even know if the autopilot was on in this case. And lots of self-driving systems are designed to ignore stationary objects at highway speeds, because they get too many false positives and would be coming to a stop on the highway too often.
- Judgmentality 8y agoThat sounds to me like the technology is too immature for a safety critical system. "We can't make this work without inconveniencing the driver, but dead people don't sue!"
- sp332 8y agoYeah, maybe. "Most adaptive cruise control systems ignore stationary objects" https://arstechnica.com/cars/2018/06/why-emergency-braking-systems-sometimes-hit-parked-cars-and-lane-dividers/ https://arstechnica.com/cars/2018/06/why-emergency-braking-s... "Cruise cars frequently swerve and hesitate." https://arstechnica.com/cars/2018/12/uber-tesla-and-waymo-all-struggled-with-self-driving-in-2018/ https://arstechnica.com/cars/2018/12/uber-tesla-and-waymo-al... This was true of Google cars at least in 2014. https://www.technologyreview.com/s/530276/hidden-obstacles-for-googles-self-driving-cars/ https://www.technologyreview.com/s/530276/hidden-obstacles-f... Here's an overview of several systems including details of Toyota and Volvo's limitations. https://www.extremetech.com/extreme/270049-why-self-driving-cars-keep-running-into-things https://www.extremetech.com/extreme/270049-why-self-driving-...
- llukas 8y agoCare to explain more about ignore heuristics? I'd die to hear about it.
- sp332 8y agoI posted some links elsewhere in the thread, but the problem is pretty simple. The faster the car is going, the further ahead it needs to look. But the further away it looks, the lower the effective resolution of the sensors is. Eventually it can't tell the difference between an object in the lane and an object next to the lane, or a metal plate that's part of the road and something that's sticking up.
- llukas 8y agoGoing as fast as you can handle is one of top rules that every driver is/should be thought. Why AI is exempt?
- LoSboccacc 8y agobecause it's a race between startups and other entities whose option is profitability or foreclosure. it's their standard mode of operation, move fast and break humans. no idea why people thought companies would have handled this differently. beyond that, it's the usual overselling 'neural network' and other classification technologies as AI, of which they are not.
- tyingq 8y agoYour first sentence is an important point. I don't understand the rest of the comment though. Hard to reconcile "self-driving" with "ignore stationary objects".
- glennpratt 8y agoThere are many other systems like this on other cars, like the Subaru I just rented. There is no way I would trust them to not kill me unmonitored. I don't think of anything available to end users today as "self-driving". Auto pilot is a better analogy, even if people don't seem to understand that.
- darkpuma 8y agoIt doesn't help that Elon misleads the public. Tesla's "autopilot" is a Level 2 system; you're meant to keep your hands on the wheel. And indeed that's exactly what the owners manual tells you: keep your hands on the wheel. But then Elon goes on national television and takes his hands off the wheel. What kind of message does that send to consumers? Then there is the matter of autopilot being a bad analogy, even if it were technically accurate (I dispute that because AFAIK airplane autopilots officially allow pilots to take their hands off the controls, unlike Tesla's system), because the general public has serious misconceptions about what airplane autopilots actually do. Aircraft pilots receive serious training, so they don't have those same misconceptions, which is why aircraft autopilots aren't a problem. But much of the general public is under the mistaken impression that pilots of modern airliners simply "push a button then take a nap" as the airplane takes off, flies and lands itself. That's not reality as you and I both know, but many in the general public have that misconception, making Tesla's use of the term likely to mislead and therefore irresponsible. See page 73-74 of the Model 3 owners manual: https://www.tesla.com/content/dam/tesla/Ownership/Own/Model%203%20Owners%20Manual.pdf https://www.tesla.com/content/dam/tesla/Ownership/Own/Model%... Warning: Autosteer is a hands-on feature. You must keep your hands on the steering wheel at all times. Warning: Autosteer is intended for use only on highways and limited- access roads with a fully attentive driver. When using Autosteer, hold the steering wheel and be mindful of road conditions and surrounding traffic.* Warning: Autosteer is not designed to, and will not, steer Model 3 around objects partially or completely in the driving lane. Always watch the road in front of you and stay prepared to take appropriate action. It is the driver's responsibility to be in control of Model 3 at all times.