4 ms·
I wonder what will win out: first party solutions that fiddle with context under-the-hood, or open solutions that are built on top and provide context managemen
by jMyles 1y ago
I wonder what will win out: first party solutions that fiddle with context under-the-hood, or open solutions that are built on top and provide context management in some programmatic and model-agnostic way. I'm thinking the latter, both because it seems easier for LLMs to work on it, and because there are many more humans working on it (albeit presumably not full time like the folks at anthropic, etc).
Seems like everyone is working to bolt-on various types of memory and persistence to LLMs using some combination of MCP, log-parsing, and a database, myself included - I want my LLM to remember various tours my band has done and musicians we've worked with, ultimately to build a connectome of bluegrass like the Oracle of Bacon (we even call it "The Oracle of Bluegrass Bacon").
https://github.com/magent-cryptograss/magenta https://github.com/magent-cryptograss/magenta