3 ms·
So now we all know- Elaine Herzberg did not run out in front of the car, as the police said, she was walking at a normal pace; she was not in the shadows- the c
by YeGoblynQueenne 9y ago
So now we all know- Elaine Herzberg did not run out in front of the car, as
the police said, she was walking at a normal pace; she was not in the shadows-
the camera footage is typically darker than human vision; and the reason why
the first thing the driver knew of the crash was the sound of it is because
she didn't have her eyes on the road.
And all the cars sensors, its superior perception of its environment and its
superhuman reaction times were no use, without a human-level understanding of
its environment to go with them. It couldn't tell that there was a person
crossing the road in front of it and even if it did it didn't have a concept
of what a person is and why it should try to avoid them, or in any case, it
just didn't know what to do about it.
So can we now please roll back the off-the-charts hype about self-driving cars
being safer than human drivers? It's abundantly clear that this is not yet the
truth (not yet. yet). That's just not the state of the art, at this point.
We're like the people jumping off towers with crazy "flying" apparatus, in the
18th century, because they were convinced they could fly that way.
Or maybe we should just stop pretending that what we really care about is
safety and let's we just want to have cool tech toys to play with, no
matter the consequences.
- andygates 9y agoYou're missing the (admittedly comfy) narrative that the other tech companies are being diligent and careful while Uber are a bunch of cowboys rushing alpha code out into public, who only change stuff when they get caught. The autocar fan's worst nightmare.
- YeGoblynQueenne 9y agoI noticed that trend in comments, yes. Unfortunatly, the real issue with what Uber or Waymo (or anyone else) are doing it's with the limitations inherent in the technology itself, specifically, machine learning for object recognition and identification and for the learning of complex beheaviours. The limitation is -it's a bit technical, but basically, in principle, machine learning is possible under certain assumptions, as laid out by Valiant in his PAC-learning paper (A Theory of the Learnable), especially the assumption that a training sample will have the same distribution as unseen data. Under this condition, machine learning can be said to work and we can look at performance metrics and be happy they look good. Well, except that the real world has no obligation to operate under our experimental assumptions, so once you deploy machine learning systems in the real world, their performance goes down, because you haven't seen nearly enough of the data you really need to see, in the lab. And, if you attach such assumptions to safety-critical systems, then you're taking an unknown and unquantifiable risk. Or in other words, you're putting peoples' lives in danger. And that's everyone who uses machine learning to train cars to drive in real-world conditions. Not just Uber.
- 317070 9y agoYes, but that is not specific to machine learning. Humans have also learned to drive under the assumption that future observations will somewhat be alike what they have seen in the past. And yes, that is putting peoples' lives in danger. But that has nothing to do with machine learning. It has to do with all control systems, human or machine.
- deleted 9y ago[deleted]
- YeGoblynQueenne 9y agoThe point is that machine learning algorithms' decisions always have some amount of error, and that this error goes way up in the real world. The auto-car industry's marketing claims that self-driven vehicles are safer than humans just because computers have faster "reaction times" (they probably mean faster retrieval from memory). But if your reaction is completely wrong it doesn't matter how fast you react. Reacting very fast with very high error will just cause a very fast accident- and make it harder for puny humans' reflexes to avoid it, to boot.
- rcxdude 9y agoYou seem to be jumping to conclusions as much as anyone else here.