3 ms·
It's doing all these things (basic code generation, arithmetic, function composition) without specifically being trained for any of these tasks. It was basical
by spyder 6y ago
It's doing all these things (basic code generation, arithmetic, function composition) without specifically being trained for any of these tasks.
It was basically just trained to predict the next most likely word from a prompt and yet all those interesting things "emerges" from it.
And giving it more compute power it still keeps improving so far.
- abernard1 6y ago> And giving it more compute power it still keeps improving so far. And giving it more data, it still keeps improving. The extra compute is necessary to compress and train the model. At the end of the day, we've proven if you have more human knowledge in your lookup table, you can generate more things convincingly. Search engines have been doing something similar for a long time, except instead of generating things, they find them. Search engines also have the advantage that a lot of their knowledge does actually have real semantic models, which seems more intelligent to me.