Just my opinion, but look into the "Overparameterized machine learning" community[0]. If you are interested in the theory, this gets at what is fundamentally di

Just my opinion, but look into the "Overparameterized machine learning" community[0]. If you are interested in the theory, this gets at what is fundamentally different about deep learning. I may be reading too deeply into your question and you don't actually mean that theoretical. For something lighter, I'd suggest studying some of the common model architectures in the area you're interested in (like you can look at the pytorch lightning or torchvision or detectron2 models or etc source code) and understanding why things are the way they are. [0] https://topml.rice.edu/ https://topml.rice.edu/ (this is an annual conference, can look at last years talks and references therein, search for topml, etc)