3 ms·
I believe a (packer[1]) AGI is possible now thanks to the memory prosthesis that is part of MemGPT[2]. Packers are people who memorize facts to cope with the w
by mikewarot 3y ago
I believe a (packer[1]) AGI is possible now thanks to the memory prosthesis that is part of MemGPT[2].
Packers are people who memorize facts to cope with the world. My experience working with them is they are very capable people, but when they are forced to deal with Computers, their mental model of the world breaks... any deviation from the expected response throws them off. If you give them instructions that account for those variations, they then do just fine again. 8) (It took a while to figure out what was going on, and how to deal with them)
I believe the small context window of LLMs will tend to force it into a packer style of thinking. (Once it's no longer in training, it only has the "compiled" knowledge to fall back on, and it can't learn any new deep assumptions)
I'm not sure how you would go about training a (mapper) style AGI.
One thing that is very clear to me is that there's a superhuman level of learning in process while an LLM is being trained. Features present in the training data are compiled into the resulting weights. The fact that the resulting intelligence is even able to coherently communicate through the slightly randomized bag of words output system, with all of it's inherent loss, surely hints at this.
[1] https://wiki.c2.com/?MappersVsPackers https://wiki.c2.com/?MappersVsPackers
[2] https://memgpt.ai/ https://memgpt.ai/