3 ms·
In this case you wouldn't spam the context window, you would perhaps just send latest time every time and lose portion of the previous times.
by mewpmewp2 3y ago
In this case you wouldn't spam the context window, you would perhaps just send latest time every time and lose portion of the previous times.
- Retric 3y agoThat solves this specific issue, but it isn’t a general solution to the finite size of a context window. Ideally the system should be able to decide for itself what information it needs to pay attention to, but LLM’s simply don’t operate in that fashion.
- mewpmewp2 3y agoBut you can, e.g. you allow GPT to call functions to store embeddings that it can later retrieve for the memory. Meanwhile default context memory window is just recent info more detailed and historical info gets more and more summarized, possibly summarized by GPT itself.