This tutorial seems quite good. Covers the basic and various useful UCT extension: https://webdocs.cs.ualberta.ca/~mmueller/courses/2014-AAAI-games-tutorial/sli

This tutorial seems quite good. Covers the basic and various useful UCT extension: https://webdocs.cs.ualberta.ca/~mmueller/courses/2014-AAAI-games-tutorial/slides/AAAI-14-Tutorial-Games-5-MCTS.pdf https://webdocs.cs.ualberta.ca/~mmueller/courses/2014-AAAI-g... However, the tutorial doesn't work towards a working implementation. I think you can verify your results against benchmark problems. There are a number of good implementations around: UCT implementation with many MDP benchmark problems: https://github.com/bonetblai/mdp-engine https://github.com/bonetblai/mdp-engine My favorite implementation. The code is quite easy to read: http://www0.cs.ucl.ac.uk/staff/D.Silver/web/Applications_files/pomcp-1.0.tar.gz http://www0.cs.ucl.ac.uk/staff/D.Silver/web/Applications_fil...