It was not a language model, but AlphaZero played against itself millions of games and trained on the data it generated, without seeing any human games. And it

It was not a language model, but AlphaZero played against itself millions of games and trained on the data it generated, without seeing any human games. And it reached super human level, of course. Why was this possible? The game itself acted as an anti-bullshit filter. So you can train on your own generated data if you filter it. Like this one: Large Language Models Can Self Improve https://arxiv.org/abs/2210.11610 https://arxiv.org/abs/2210.11610