3 ms·
That's not an answer. The given question is one which requires some spatial reasoning to understand. By default, GPT can only understand spatial questions as d
by PoignardAzur 4y ago
That's not an answer.
The given question is one which requires some spatial reasoning to understand. By default, GPT can only understand spatial questions as described by text tokens which is a pretty noisy channel. So it's not obvious how GPT-4 could answer a spatial reasoning question (aside from memorizing it).
- lucubratory 4y agoLLMs can build an internal world model and use it at inference time in order to understand spatial problems and rulesets. It's part of the often overlooked "How does it do that though?" counterpart to the often repeated "It's just predicting the next most likely token." Here's the write-up I've found that's the most clear, there are several other papers and ongoing research finding this though: https://thegradient.pub/othello/ https://thegradient.pub/othello/
- Method-X 4y agoThis is a good explanation: https://www.youtube.com/watch?v=qbIk7-JPB2c https://www.youtube.com/watch?v=qbIk7-JPB2c
- qumpis 4y agoWhy does it require spatial reasoning if it can learn the (logical) rule of how the mirroring and glass doors behave?