3 ms·
Why truncate the conversation? Why not have the LLM generate a summary, and use that instead of a truncated conversation? That seems closer to what we do, we r
by magicalhippo 3y ago
Why truncate the conversation? Why not have the LLM generate a summary, and use that instead of a truncated conversation?
That seems closer to what we do, we recall the important bits without every single word said.
- brucethemoose2 3y agoThis is not a bad idea. Some roleplaying UIs kinda do this. But its also several passes through the LLM instead of one, and is prone to distortion.