4 ms·
In a previous discussion regarding RL learning materials, https://news.ycombinator.com/item?id=20294453 https://news.ycombinator.com/item?id=20294453 Someone c
by billconan 7y ago
In a previous discussion regarding RL learning materials, https://news.ycombinator.com/item?id=20294453 https://news.ycombinator.com/item?id=20294453
Someone commented:
> there's still no great resource to learn RL "from scratch" - there's still a huge gap between Sutton&Barto and implementing DDPG. You have to figure out everything by reading existing implementations, various Medium posts (a lot of them containing errors and imprecisions), and research papers. I wouldn't consider Spinning Up as a beginner-friendly resource, it's too dense/math-heavy. The closest I have found so far is the Udacity course: https://eu.udacity.com/course/deep-reinforcement-learning-na.. https://eu.udacity.com/course/deep-reinforcement-learning-na.... which costs $1000
I too think OpenAI's Spinning Up isn't beginner-friendly. But I also don't want to just learn bandits and tic-tac-toe. Will this course fill the gap?
- camlinke 7y agoAgreed! A lot of material out there is like the "how to draw and owl" meme: https://imgur.com/gallery/RadSf https://imgur.com/gallery/RadSf - start with bandits and now do DDPG. The goal is for this course to provide the foundations for whatever folks want to do in RL after. It starts with bandits but then covers things like TD, Sarsa, Dyna, etc. in the tabular setting. Then folks learn about more advanced topics like linear and non-linear function approximation (read - linear e.g. Tile Coding, non-linear e.g. neural nets/deep rl). This very much follows the intro RL course taught by Martha/Adam/Rich at the U of A, and follows Rich's textbook really closely.