I'll go further: For each problem there are a few sub-problems and a "right way" to do each of them where a "right way" corresponds to an algorithm which effic

I'll go further: For each problem there are a few sub-problems and a "right way" to do each of them where a "right way" corresponds to an algorithm which efficiently tackles some element of the implicit structure of the problem. I think within 5 years we will have made great progress on algorithmically discovering these "right ways" across many problem domains. I think both differentiable neural architecture search[0] and the MAML with implicit gradients[1] stuff is very interesting from this perspective. [0]https://arxiv.org/abs/1905.13577 https://arxiv.org/abs/1905.13577 [1]https://arxiv.org/abs/1909.04630 https://arxiv.org/abs/1909.04630