4 ms·
I'm curious how it will avoid filling up the context window as more memories are added.
by joquarky 2y ago
I'm curious how it will avoid filling up the context window as more memories are added.
- refulgentis 2y agoCount the tokens, RAG em down to max count you're willing to pay for
- hackable_sand 2y agoVector compression. "Summarize memories at timestamps: [i, j, k, ...n]" etc. etc. until you have a nice scrapbook of memories. Then you gotta prune low-traffic, low-value vector spaces by whatever heuristic you (or an automated system) deems important.