2 ms·

I don't know, it actually feels quite similar to something that seems to happen in my head. In a certain context, my brain resurfaces a bunch of memories and th

I don't know, it actually feels quite similar to something that seems to happen in my head. In a certain context, my brain resurfaces a bunch of memories and thoughts of things that are similar, even if they are not necessarily valuable to the current situation. I am not saying that the how is equivalent, but the what certainly seems at least related.

mike_hearn 3y ago
Yes but RAG isn't re-surfacing memories, it's re-surfacing documents i.e. the source of memories. That's what this new paper tackles: how do you resurface actual memories or the closest analogy at the neural architecture level.