4 ms·
Interesting that Lee Sedol losing at Go was the big opening act in the modern AI wave, but it ended up coming from a completely different technology that has ef
by bpodgursky 2y ago
Interesting that Lee Sedol losing at Go was the big opening act in the modern AI wave, but it ended up coming from a completely different technology that has effectively faded into the background.
- brian_cloutier 2y agohow so? modern post-training uses RL and immense amounts of synthetic data to iteratively bootstrap better performance. if you squint this is extremely similar to the AlphaZero approach of iteratively training using RL over data generated through self-play
- mastazi 2y ago> completely different technology that has effectively faded into the background. If by that you mean reinforcement learning, that's not the case; e.g. see https://arxiv.org/abs/2501.12948 https://arxiv.org/abs/2501.12948
- fancyfredbot 2y agoThey used deep neural networks, reinforcement learning, and Monte Carlo tree search. All except the MCTS are critical components of modern LLMs. MCTS is a form of planning which you can argue has parallels to "reasoning" models, although that's pretty tenuous I admit.