3 ms·
AI is not just that. That's a myth. Yes, when you train on a human generated corpus you're going to get an interpolative AI. But when you train on a dataset ge
by visarga 4y ago
AI is not just that. That's a myth.
Yes, when you train on a human generated corpus you're going to get an interpolative AI. But when you train on a dataset generated by AI, you can surpass human level.
AlphaZero started, as the name says, from zero. No examples of how we play the game. In just three days of self-play it surpassed the best human. How was that possible? We got a 2000 year head start, larger brains, and many players, not just one model. AlphaZero did it by creating its own training data.
Here is an example of using code language models for this kind of dataset-creation by play.
> Evolution through Large Models
https://arxiv.org/abs/2206.08896 https://arxiv.org/abs/2206.08896
By the way, GPT-3 and chatGPT are not simple interpolative language models. They have also been trained on many tasks, problems, and codes, which is the kind of data that will awaken the skills of the model to a whole new level. What I am saying is that we can auto-generate more problem data and increase their skills.