3 ms·
Have you tried something like Memory Transformers https://arxiv.org/abs/2006.11527 https://arxiv.org/abs/2006.11527 where you move the k/v pairs that don't fit
by thomasahle 3y ago
Have you tried something like Memory Transformers https://arxiv.org/abs/2006.11527 https://arxiv.org/abs/2006.11527 where you move the k/v pairs that don't fit in the context window to a vector db? Seems like a more general approach, but I have tested then against each other.