4 ms·
> Each chatbot has unlimited memory capacity, enabling seamless interaction with large files such as a 400-page PDF. How is this possible? Do they do fancy tri
by jerpint 3y ago
> Each chatbot has unlimited memory capacity, enabling seamless interaction with large files such as a 400-page PDF.
How is this possible? Do they do fancy tricks at inference?
- minimaxir 3y agoLikely an embeddings vector store, which is not "memory" as traditionally defined in conversational AI apps.
- killthebuddha 3y agoI've scanned the codebase and IMO the statement is mostly misleading. I think LangChain agents (which this is a thin wrapper around) do have some default compression/reranking behavior to help fit relevant context into the context window, but it's very, very, very far from actually infinite short-term memory. I think the framing where the statement could be considered true is if you assume "memory = persistent storage", which is IMO not what most people will do. Note: I'm not trying to imply the authors are being intentionally misleading.