All of their arguments for why deep learning is reaching its limits seem to me to be arguments for why its future is bright. The fact that we have no even halfw

All of their arguments for why deep learning is reaching its limits seem to me to be arguments for why its future is bright. The fact that we have no even halfway plausible theory of why deep models generalize well, or why training them via sgd works, or even what the effect of depth is in a neural network, is exciting, not discouraging. I do not believe these are impossible problems to solve (well maybe the generalization one, but even there surely more can be said than the current state of knowledge which is basically a shrug). And even partial solutions should yield big practical steps forward.