4 ms·
Reading that article I can't help but see similarities between what we have in the human brain. We can easily form and recall short term memories, even using th
by rdedev 3y ago
Reading that article I can't help but see similarities between what we have in the human brain. We can easily form and recall short term memories, even using them to logically reason out facts, but loose such memories if it's not frequent enough. So it seems like the context prompt is similar to short term memory and what's missing now is a good way to transfer the short term to long term. There is a huge amount of assumptions going on here so take it with a huge amount of salt.
On another note I should have read the actual paper mentioned in the post critically instead of just skimming it. I completely missed the footnote about the reversal curse not being a problem if everything is present in the initial prompt