4 ms·
There's a good summary in the Introduction to Kevin Murphy's second tome [1]. He quotes Josh Tenenbaum, who said: "Intelligence is not just about pattern recogn
by nextos 3y ago
There's a good summary in the Introduction to Kevin Murphy's second tome [1]. He quotes Josh Tenenbaum, who said: "Intelligence is not just about pattern recognition and function approximation. It’s about modeling the world".
I agree, and I think Goodman & Tenennaum [2] is a great place to see other things that may pop up in the road to AGI. LLMs are great, but they do too much at once. I think moving towards AGI requires some form of symbolic reasoning, possibly combined with LLMs, which may play the role of intuition and kitchen-sink memory.
[1] https://probml.github.io/pml-book/book2.html https://probml.github.io/pml-book/book2.html
[2] https://probmods.org https://probmods.org
- willbudd 3y agoModelling the world is function approximation: the world is the function and the model is the approximation.
- NumberWangMan 3y agoDo we know for sure that LLMs can't possibly be doing symbolic reasoning of some sort, internally? I thought we couldn't really interpret them yet.
- stevenhuang 3y agoThere's mounting evidence LLMs do appear to form models of the real world https://thegradient.pub/othello/ https://thegradient.pub/othello/