3 ms·
I was thinking the way the LLMs work is quite similar to a human reading a lot of books and remembering the stuff in them be able to answer questions but not re
by tim333 2y ago
I was thinking the way the LLMs work is quite similar to a human reading a lot of books and remembering the stuff in them be able to answer questions but not really thinking about it. GPT4 already read all the stuff and can answer back so it's hard to do much better there.
The next step would seem maybe to think about it, which o1 is maybe making a start on. If you think of humans learning say programing, they read the books and can answer questions but they have to do exercises, write code and so on which gives greater understanding which is maybe where AI needs to go next.
By the way the Altman Tan Nov 8th interview which is a source for most of the Altman mentions in the article is worth a view if you skip the boring bits https://youtu.be/xXCBz_8hM9w https://youtu.be/xXCBz_8hM9w