4 ms·

Thanks for your feedback @skrebbel. We called it MemGPT - in reference to teaching LLMs how to manage their own memory hierarchy. The idea and title evolved whe

by pacjam 3y ago

Thanks for your feedback @skrebbel. We called it MemGPT - in reference to teaching LLMs how to manage their own memory hierarchy. The idea and title evolved when we realized we were teaching the LLM to read/write, and this enabled perpetual chatbots, doc QA, etc. Various capabilities by a few simple abstractions, inspired by the original unix paper's 4 key abstractions - read/write/open/close. Further, in the title we say "Towards", indicating a qualified step in that direction.

__void 3y ago
still this is not an "operating system" nor does it in any way related to them; please use the right words when you have to communicate, otherwise you just sound like scammers who want to sell pots with holes by passing them off as colanders
skrebbel 3y ago
Perpetual chatbots are a super cool achievement but I fail to see how that resembles an OS, a thing that handles files and lets you run programs, in any way. If MemGPT is as spectacular as you suggest then I think an honest, down to earth title would have gotten you a lot more attention. It seems to me that limited context windows are one of the key roadblocks to wider real-world LLM applicability, beyond demos that do well on Twitter I mean.
- selestify 3y ago
  > If MemGPT is as spectacular as you suggest then I think an honest, down to earth title would have gotten you a lot more attention. The fact that the current title got onto the HN front page suggests otherwise when it comes to incentives for picking submission titles.
abdellah123 3y ago
> we were teaching the LLM to read/write Very interesting.
ludwik 3y ago
I think a title like "MemGPT: Operating System inspired memory management for LLMs" would be okay. The current title makes it seem as if you are building an OS based on the LLM technology, which is quite misleading.

4 ms·

Thanks for your feedback @skrebbel. We called it MemGPT - in reference to teaching LLMs how to manage their own memory hierarchy. The idea and title evolved whe

by pacjam 3y ago

__void 3y ago
still this is not an "operating system" nor does it in any way related to them; please use the right words when you have to communicate, otherwise you just sound like scammers who want to sell pots with holes by passing them off as colanders
skrebbel 3y ago
Perpetual chatbots are a super cool achievement but I fail to see how that resembles an OS, a thing that handles files and lets you run programs, in any way. If MemGPT is as spectacular as you suggest then I think an honest, down to earth title would have gotten you a lot more attention. It seems to me that limited context windows are one of the key roadblocks to wider real-world LLM applicability, beyond demos that do well on Twitter I mean.
- selestify 3y ago
  > If MemGPT is as spectacular as you suggest then I think an honest, down to earth title would have gotten you a lot more attention. The fact that the current title got onto the HN front page suggests otherwise when it comes to incentives for picking submission titles.
abdellah123 3y ago
> we were teaching the LLM to read/write Very interesting.
ludwik 3y ago
I think a title like "MemGPT: Operating System inspired memory management for LLMs" would be okay. The current title makes it seem as if you are building an OS based on the LLM technology, which is quite misleading.