3 ms·
sounds brilliant. What is the impact on the token consumption ?
by gilles_oponono 7mo ago
sounds brilliant. What is the impact on the token consumption ?
- Bumblebiber 7mo agoThanks <3 I designed it to be very token saving. It loads mostly the very brief summaries of each memory (and there's an algorithm which filters out the lesser important ones). Only if the agent need to know more details, it will dig deeper into each entry.