https://stable-baselines3.readthedocs.io/en/master/ https://stable-baselines3.readthedocs.io/en/master/ is a great resource for hacking on implementations for R

https://stable-baselines3.readthedocs.io/en/master/ https://stable-baselines3.readthedocs.io/en/master/ is a great resource for hacking on implementations for RL - many good RL courses out there but https://www.youtube.com/playlist?list=PLwRJQ4m4UJjNymuBM9RdmB3Z9N5-0IlY0 https://www.youtube.com/playlist?list=PLwRJQ4m4UJjNymuBM9Rdm... is my personal favorite. For LLMs / RLHF it's a little more difficult but https://github.com/huggingface/alignment-handbook https://github.com/huggingface/alignment-handbook and the Zephyr project is a good collection of model / dataset / script that is easy to follow. I would suggest studying the basics of RL first before diving into LLM RLHF, which is much harder to learn on a single GPU.