4 ms·
I'm not sold on this. The ability to often reasonably combine knowledge to derive new solutions to a problem to me implies some kind of model of a world. If it
by bakuninsbart 3y ago
I'm not sold on this. The ability to often reasonably combine knowledge to derive new solutions to a problem to me implies some kind of model of a world. If it fails it might as well just be a model of a very different, wrong world. The idea that we have "persistent memory" of contextual knowledge is also questionable, relations generally don't seem to be hard-coded in the brain.
In the optimal scenario, it would just be sufficient to massively increase the context space of current LLMs.