imo, instead of developing new theory entirely from the ground up, its more useful to address & work in the context of understanding longstanding open problems/

imo, instead of developing new theory entirely from the ground up, its more useful to address & work in the context of understanding longstanding open problems/phenomenon. Theoretical insight and the framework should follow. e.g. Robustness & expressiveness Memorization & catastrophic forgetting Ensembling & ntk & optimization Double descent Pruning