4 ms·
It has the ability to reason. It may not be conscious, but it is intelligent.
by Method-X 3y ago
It has the ability to reason. It may not be conscious, but it is intelligent.
- PoignardAzur 3y agoThat's not an answer. The given question is one which requires some spatial reasoning to understand. By default, GPT can only understand spatial questions as described by text tokens which is a pretty noisy channel. So it's not obvious how GPT-4 could answer a spatial reasoning question (aside from memorizing it).
- lucubratory 3y agoLLMs can build an internal world model and use it at inference time in order to understand spatial problems and rulesets. It's part of the often overlooked "How does it do that though?" counterpart to the often repeated "It's just predicting the next most likely token." Here's the write-up I've found that's the most clear, there are several other papers and ongoing research finding this though: https://thegradient.pub/othello/ https://thegradient.pub/othello/
- Method-X 3y agoThis is a good explanation: https://www.youtube.com/watch?v=qbIk7-JPB2c https://www.youtube.com/watch?v=qbIk7-JPB2c
- qumpis 3y agoWhy does it require spatial reasoning if it can learn the (logical) rule of how the mirroring and glass doors behave?