3 ms·

> What's worrying isn't that the autopilot didn't "know what to do"; but that it didn't detect the oncoming parked car at all. This is not simply a parked car,

> What's worrying isn't that the autopilot didn't "know what to do"; but that it didn't detect the oncoming parked car at all. This is not simply a parked car, this is a dark non-reflective crashed pick-up truck sideway on a highway lane that's CURVED at night. There are multiple variables all of which are bad; non-reflective, driving high speed (75mph) in a curved lane, and night-time. Worse, this car's detection system is based on video camera only, it does not have LIDAR. That's where Tesla has a big problem with and it clearly shows here. Video camera-only system has blind spots and using auto-pilot or self-driving system with this only is not a good idea, period. In addition, we're not supposed to rely on autopilot only regardless of how good anything is; this is all is supposed to be a complimentary tool just like every other safety feature within the car; the cruise control feature is not supposed to be used blindly on its own and excellent human drivers with cruise control can still hit that car. There's no 100% foolproof algorithm or method to predict every single scenario. If the driver was relying on the auto-pilot and some kind of detection system and didn't pay attention, then it is not the system that failed, it is the driver's fault entirely. > "Most" (meaning > 50 percent) is just off the page, and doesn't jibe with reality. Sounds like you're a bit too eager to give Tesla a pass, here. I'm not giving anyone a pass, I'm pointing out that humans have their own weaknesses and blind spots that machines can help with but humans on their own, will not be doing better in this specific scenario with all of these variables. I can actually understand why the system failed to do anything given the technology with limited sensor data but I don't understand why they didn't use more sensors like lidar, infrared or emergency breaking system or so on. I may be missing something here. Regardless, we're not looking at a scenario where it happens every day, it only takes one bad accident and one tired human to turn an uncommon scenario into a disaster. So, it doesn't matter what percentage we deal with.

moistly 5y ago
> If the driver was relying on the auto-pilot and some kind of detection system and didn't pay attention, then it is not the system that failed, it is the driver's fault entirely. IMO it’s the fault of the engineers who did not take human factors into account. We all know that humans are terrible at following instructions or even using common sense — hence warnings about not using your toaster in the bathtub — so when engineers pretend that users will do the right thing, the engineers are at fault for not addressing the behaviours of the multitudes who will not do the right thing. TLDR: the driver is at fault for being a dumbass using autopilot at night, and Tesla is at fault for not considering how real humans will use the product.
- vanusa 5y ago
  Tesla is at fault for not considering how real humans will use the product. I think they know perfectly well, on some level. As they are of the fact that large portion of their drivers will be perfect dumbasses. But they're invested too deeply in the promise of an "Autopilot" product (which of course consumers will take to mean exactly what it says) by this point that they're not going to backpedal or change course -- unless forced to do so.

moistly 5y ago

> If the driver was relying on the auto-pilot and some kind of detection system and didn't pay attention, then it is not the system that failed, it is the driver's fault entirely. IMO it’s the fault of the engineers who did not take human factors into account. We all know that humans are terrible at following instructions or even using common sense — hence warnings about not using your toaster in the bathtub — so when engineers pretend that users will do the right thing, the engineers are at fault for not addressing the behaviours of the multitudes who will not do the right thing. TLDR: the driver is at fault for being a dumbass using autopilot at night, and Tesla is at fault for not considering how real humans will use the product.

vanusa 5y ago
Tesla is at fault for not considering how real humans will use the product. I think they know perfectly well, on some level. As they are of the fact that large portion of their drivers will be perfect dumbasses. But they're invested too deeply in the promise of an "Autopilot" product (which of course consumers will take to mean exactly what it says) by this point that they're not going to backpedal or change course -- unless forced to do so.