4 ms·
AlphaZero is entirely different than training an LLM. AlphaZero can play against itself as a simulated opponent to make itself better, ChatGPT using its own out
by ladberg 4y ago
AlphaZero is entirely different than training an LLM. AlphaZero can play against itself as a simulated opponent to make itself better, ChatGPT using its own output as training data will just cause future iterations to optimize for a lower (and less human) bar than the original.
- moyix 4y agoHere’s a more directly comparable example: https://arxiv.org/abs/2210.11610 https://arxiv.org/abs/2210.11610
- m00x 4y agoBut then you can use a GAN to create a bunch of chatGPT data and try to detect it vs known human data, which will optimize chatGPT to generate even more human-like content. This isn't a huge problem, it's barely a problem.