4 ms·
If you mean the lack of theoretical guarantees due to a highly non-convex optimization, you could argue the same thing about 30 year old 2-layer networks. And w
by rm999 10y ago
If you mean the lack of theoretical guarantees due to a highly non-convex optimization, you could argue the same thing about 30 year old 2-layer networks. And we actually do have a decent idea why deep learning works well:
http://arxiv.org/pdf/1412.6544v4.pdf http://arxiv.org/pdf/1412.6544v4.pdf
http://arxiv.org/pdf/1412.0233.pdf http://arxiv.org/pdf/1412.0233.pdf
- mathgenius 10y agoThankyou that looks awesome. Btw, "why" questions are always a bit ill-defined, it's like asking for some kind of narrative to satisfy the questioner. "well in the beginning there was the big-bang..." So anyway I'm quite impressed at these papers.