3 ms·
I'm new to the field. What makes you say that shallow and deep networks have equivalent accuracy? Is there a recent publication/experiment I missed? Thanks!
by batmansmk 9y ago
I'm new to the field. What makes you say that shallow and deep networks have equivalent accuracy? Is there a recent publication/experiment I missed? Thanks!
- klowrey 9y agohttps://arxiv.org/abs/1703.02660 https://arxiv.org/abs/1703.02660 Disclosure: I contributed to the linked work. To do simple tasks, you don’t even need neural networks, in short. If you want to do complex tasks, training the neural net isn’t the problem, but a NN can indeed represent more than say a linear policy. The issue is getting the NN to do the complex thing correctly: it’s more of an exploration problem than function approximation problem.
- hyperbovine 9y ago> To do simple tasks, you don’t even need neural networks, in short. Ssh! We've got a gold rush to maintain.