3 ms·
I've scanned the codebase and IMO the statement is mostly misleading. I think LangChain agents (which this is a thin wrapper around) do have some default compre
by killthebuddha 3y ago
I've scanned the codebase and IMO the statement is mostly misleading. I think LangChain agents (which this is a thin wrapper around) do have some default compression/reranking behavior to help fit relevant context into the context window, but it's very, very, very far from actually infinite short-term memory.
I think the framing where the statement could be considered true is if you assume "memory = persistent storage", which is IMO not what most people will do.
Note: I'm not trying to imply the authors are being intentionally misleading.