Great! I would argue that no, there's still no great resource to learn RL "from scratch" - there's still a huge gap between Sutton&Barto and implementing DDPG.

Great! I would argue that no, there's still no great resource to learn RL "from scratch" - there's still a huge gap between Sutton&Barto and implementing DDPG. You have to figure out everything by reading existing implementations, various Medium posts (a lot of them containing errors and imprecisions), and research papers. I wouldn't consider Spinning Up as a beginner-friendly resource, it's too dense/math-heavy The closest I have found so far is the Udacity course: https://eu.udacity.com/course/deep-reinforcement-learning-nanodegree--nd893 https://eu.udacity.com/course/deep-reinforcement-learning-na... which costs $1000 So yeah, I'm excited to see what you've done! I'm working on a similar course, FYI.