It's the kind of thing where it's sort of expected that you wouldn't know, right? I think we don't really understand why deep learning works as well as it does

It's the kind of thing where it's sort of expected that you wouldn't know, right? I think we don't really understand why deep learning works as well as it does, the thinking around that is, as far as I can tell, mostly a collection of empirical observations. A fundamental theory of learning that can be used to predict optimal network architectures might enable smaller models that consume less energy.