3 ms·
I was just suggesting something like this to a friend yesterday! (Neither of us know enough to do it or know if it's a good idea.) However, I do think the cont
by wilg 3y ago
I was just suggesting something like this to a friend yesterday! (Neither of us know enough to do it or know if it's a good idea.)
However, I do think the context length is one of the top improvements that would make LLMs much more useful.
- littlestymaar 3y agoSame here, it looks like the idea was pretty obvious. Glad to see it implemented though. Context length being so limited is the number one thing that rules LLM as possessing something that resemble “intelligence”, so if we this kind of unbounded context length we're entering into a completely new universe in terms of LLM abilities.
- shishirpatil 3y agoThanks @wilg and @littlestymaar ! Yeah totally, with the benefit of hindsight, this makes total sense! Hope you find some of our codebase useful to build on top of. We are an Apache 2.0 licensed open source project and welcome contributions :)
- pacjam 3y agoIf you have a chance try it out via the Discord bot or with the GitHub repo! Or even just check out the short demo GIFs we released (at https://github.com/cpacker/memgpt https://github.com/cpacker/memgpt) to get an idea of the MemGPT inputs/outputs. The high-level memory read/writes are quite intuitive and you may be surprised at how closely it matches what you were suggesting to your friend.