2 ms·
Instead of just dropping all the context, the system could also run a compaction (summarizing the entire convo) before dropping it. Better to continue with a su
by winternewt 6mo ago
Instead of just dropping all the context, the system could also run a compaction (summarizing the entire convo) before dropping it. Better to continue with a summary than to lose everything.
- Folcon 6mo agoThere's problems with this approach as well I've found I'm really beginning to feel the lack of control when it's comes to context if I'm being honest