3 ms·
Seems like this would break the cache often. That would increase billing rates with certain providers and, for local models, take a while to generate responses,
by theresLand 12d ago
Seems like this would break the cache often. That would increase billing rates with certain providers and, for local models, take a while to generate responses, especially with long-running agentic sessions. Interesting idea though.
- MikhailTal 12d agoNo? from a quick skim it doesnt look like it goes into the system prompt everytime, you just use search/grep over it. Pretty much most memory approaches relying on a big set of info where agent chooses what to 'recall'. Its like any other tool