3 ms·
When we design classical control systems, the performance limitations are well understood. If we do not exceed the limits, we expect the system to be well beha
by comfysocks 5y ago
When we design classical control systems, the performance limitations are well understood. If we do not exceed the limits, we expect the system to be well behaved. By contrast, DNN/CNN based systems can be a bit of a black box. We can only evaluate performance empirically, not analytically. It is difficult to know where in the input space the failure modes lie. It is difficult to then build the larger system around it, because you do not know were the keep-out zones are.
I think a study of the failure modes of CNNs shouldn't be interpreted as an all-or-nothing evaluation of the technology as a whole, but rather a step towards gaining some confidence regarding its reliability. A lot more work needs to be done before I will trust it to drive my car.
Regarding the use of CNN's for autonomous driving, I think it is insane that people are trying to do this by trying to solve a VERY hard problem, i.e. making a machine that can do what the human brain does. Your neural net does not have enough labels to account for all possible scenarios. Instead, it would make more sense to redesign the infrastructure in a way that bounds the problem space. The current system is designed for human drivers. We should make a system that is easy to interpret for both human and machine drivers. Of course this infrastructure would benefit all car makers, not just the first mover.
- mgraczyk 5y agoThe major players are not doing it the way you describe. Tesla's driving system is not a giant model trained to imitate a human brain. There are separate perception, planning, and control algorithms.
- comfysocks 5y agoThese other algorithms would be part of the "larger system built around it" that I mention. This larger system has the task of doing what human judgement does.
- mgraczyk 5y agoThe "larger system around it" is not trained to "do what a human brain does". That's called "behavioral cloning". The major players do not do that. That's why the systems are more robust than you probably think to failures in perception. It's also why these systems sometimes fail in ways that humans would never fail.
- comfysocks 5y agoI think you are misreading me. I am not trying to suggest they work in the same way, simply that they have the same overall task, which I consider to be a very difficult problem. To your second point, I think we might agree that in order to be more robust to failures in perception, it would be good to understand where the failure modes live. I personally think we need a better understanding than we have today.