3 ms·
UCB on game trees (MCTS) was the first breakthrough that created decently playing Go programs, if I remember correctly.
by praptak 7y ago
UCB on game trees (MCTS) was the first breakthrough that created decently playing Go programs, if I remember correctly.
- cgearhart 7y agoYou are correct. MCTS + UCB and other variants were state of the art leading up to AlphaGo. And even then, MCTS was also used in AlphaGo. The main change in AlphaGo was using a deep learning network to encode a value network for fast rollouts and a policy network for move selection (rather than using the UCB rule). They later removed the value network and rollouts entirely, but even AlphaZero uses MCTS.