4 ms·
It makes sense because holding users personally responsible for the inadequacies of self-driving products externalizes all the risk for companies selling self-d
by brudgers 6y ago
It makes sense because holding users personally responsible for the inadequacies of self-driving products externalizes all the risk for companies selling self-driving systems. The Uber system detected something in the road and proceeded because it did not recognize it. That's how it is designed. Otherwise the car would never go very far without stopping because the system does not recognize most things it detects.
To put it another way, the self-driving system did not alert the driver that it had detected something and did not know what it was. It wasn't an emergency, it was the car's normal operation.
- formercoder 6y agoShe wasn’t a “user”
- derwiki 6y agoThis was a training mission. Uber wasn't offering rides to passengers who weren't employees.
- bastawhiz 6y agoThe system was, by its very nature, not ready for production. That's why it had a safety driver in the first place. It's crazy to argue that the safety driver should have been alerted...the whole point they're there is to handle failures of the system, including ones where the system fails to detect an issue. If my skydive instructor doesn't deploy the backup parachute because I, the student, didn't alert them that the primary chute failed to deploy, it's entirely their fault if we hit the ground at terminal velocity. If a lifeguard is working at a public pool watching Netflix on their phone and a kid drowns, you can't argue that the kid should have splashed more.
- liability 6y agoProduction? It wasn't even ready for testing on the unsuspecting public.
- bastawhiz 6y agoI don't disagree. But that's a separate issue. The safety driver provably did not even make a good faith attempt to perform their function. It's not possible to know whether they would have been able to avoid the tragedy that occurred, but it's a certainty that in any other universe where they were watching TV on their phone they would not have improved the outcome.
- Erlich_Bachman 6y agoOf course it was "inadequate system" if you consider it a full self-driving. It is inadequate in the simple fact that it was not complete. It was under development. But how do you suppose we create FSD cars if we can't try them out before they are ready? There is just no other way to do it than vigilant drivers that watch what these cars do. > To put it another way, the self-driving system did not alert the driver that it had detected something Well of course not, who would expect that? If the car could positively identify the collision before it happened, it would have simply stopped, no need for a driver at all. The driver is there to prevent exactly this kinds of accidents, and this driver failed by getting our her phone and distracting herself with streaming videos instead of doing her one job. Plain and simple.