4 ms·
Ask HN: How to become a deep learning 'master' in 2022?
Background: I know how to program (Python, C, Racket). I have done small projects and am confident on that front that if I understand the inner workings of something, then I can build that thing using code.
Now, I want to learn Deep Learning with emphasis on computer vision although it wouldn't hurt to learn other applications. But my focus is on core deep learning and computer vision.
I want to understand research papers, implement them from scratch (using something like PyTorch) and build new models to improve upon SOTA performance. By 'master' I mean all of the above.
How to go about that? Which courses, books, tutorials are the best to focus on? I know a bit of linear algebra and calculus and hope to pick up things as I go on.
- stealthcat 4y agoYi Ma’s book and slides seems ok to me. In sense that ML is like Signal Processing and Control Theory. Though I think he is somewhat against “the bitter lesson” https://book-wright-ma.github.io/ https://book-wright-ma.github.io/ http://www.incompleteideas.net/IncIdeas/BitterLesson.html http://www.incompleteideas.net/IncIdeas/BitterLesson.html
- bjourne 4y agoImplement and train AlexNet in C without using any external libraries. Once you've done that, do the same for a text-generation LSTM. Once you've done that, write a GAN. And so on.
- p1esk 4y agoThis is the best starting point: http://neuralnetworksanddeeplearning.com/ http://neuralnetworksanddeeplearning.com/ Then: https://m.youtube.com/playlist?list=PL5-TkQAfAZFbzxjBHtzdVCWE0Zbhomg7r https://m.youtube.com/playlist?list=PL5-TkQAfAZFbzxjBHtzdVCW... and/or: https://www.fast.ai/posts/2022-07-21-dl-coders-22.html https://www.fast.ai/posts/2022-07-21-dl-coders-22.html p.s. I could only dream about such learning resources when I started as a DL researcher in 2013.
- psteitz 4y agoI would start here: https://www.deeplearningbook.org/ https://www.deeplearningbook.org/ If you already know all of the math in Part I, great, but if you don't you need to study it carefully if you want to understand what is going on. If you just want to code, there are shorter paths, but if you really want to understand the theory, you need to master the Linear Algebra and Probability material in the first part of that book. Parts II and III give a solid foundation in DL itself.