3 ms·
you mean like https://www.anthropic.com/news/prompt-caching https://www.anthropic.com/news/prompt-caching or just saving LLM chat message history? If the latt
by edunteman 1y ago
you mean like
https://www.anthropic.com/news/prompt-caching https://www.anthropic.com/news/prompt-caching
or just saving LLM chat message history?
If the latter, saving chat history is useless without some snapshot of the environment in which it was performed. Muscle Mem is an environment cache more than it is an LLM cache.