3 ms·
Off Topic : I am interested in learning DL, not superficially (like most of online courses), but a more theoretical foundation, one that enables me to think and
by kumarvvr 5y ago
Off Topic : I am interested in learning DL, not superficially (like most of online courses), but a more theoretical foundation, one that enables me to think and envisage new architectures, new techniques or combinations. Can you help me with any self study stuff that will enable me to learn as such.
- Isinlor 5y agoThere is very little theory to DL. It's almost completely about empirical results. You will be very disappointed if you expect that there is some grand theory of Deep Learning. My suggestion is to follow Arxiv Sanity: http://www.arxiv-sanity.com/top http://www.arxiv-sanity.com/top
- ZephyrBlu 5y ago> but a more theoretical foundation, one that enables me to think and envisage new architectures, new techniques or combinations Advances in DL have been mostly empirical not theoretical from what I have seen. It's less about being able to "envisage" and more about empirical testing.
- version_five 5y agoJust my opinion, but look into the "Overparameterized machine learning" community[0]. If you are interested in the theory, this gets at what is fundamentally different about deep learning. I may be reading too deeply into your question and you don't actually mean that theoretical. For something lighter, I'd suggest studying some of the common model architectures in the area you're interested in (like you can look at the pytorch lightning or torchvision or detectron2 models or etc source code) and understanding why things are the way they are. [0] https://topml.rice.edu/ https://topml.rice.edu/ (this is an annual conference, can look at last years talks and references therein, search for topml, etc)