4 ms·
If you actually read the paper, the analysis absolutely does not support the claim that LLMs are capable of maintaining a spatial or chronological internal worl
by gamblor956 3y ago
If you actually read the paper, the analysis absolutely does not support the claim that LLMs are capable of maintaining a spatial or chronological internal world model.
The LLMs simply activated when locations or times were mentioned, with no understanding of the relationship between different places or different times beyond the fact that different places and times had different tags. Or in other words, no internal model of the world.
- nyrikki 3y agoThe lack of generally accepted definition for knowledge and intelligence makes these conversations difficult but the above post is important to remember. The paper has nothing to do with the common sense problem. While it is a preprint, I do wonder how useful this will be to improve generalization. Termination analysis on linear polynomials is undecidable over the naturals without many constraints and is undecidable ofer the rationals. If you think about how sstrees or even rtrees work, this isn't surprising to me that space and time are useful for compression which is required for learnability. But I think people also see 'linear' and think that means easy. When it can mean serious restrictions on how it can be used. Hard to explain the connection I have in mind without serious math but here is a paper that may cause some issues with trying to use these internal structures outside of the learnability implications. https://arxiv.org/abs/2307.14805 https://arxiv.org/abs/2307.14805