3 ms·
It also, in my pay opinion, needs a memory store. I need to be able to save something to a variable and call back that exact variable. Right now, because it’s
by basch 4y ago
It also, in my pay opinion, needs a memory store.
I need to be able to save something to a variable and call back that exact variable. Right now, because it’s just pure text input of the whole conversation, it can forget or corrupt it’s “memory”.
Even something like writing a movie script doesn’t work if it constantly forgets characters names or settings or plot points.
- _yb2s 4y agoMy description above includes a memory store. It is a single variable that it can save and recover, and will automatically get sent back to it at regular intervals if it forgets it saved anything. Only a single text string variable is needed, as GTP-4 is smart enough to realize it can compress, pickle, etc. as many things as it needs into that.
- alchemist1e9 4y agoI think we might be working something a bit similar and I agree memory is an issue. However it’s not really AGI that will emerge from this. It’s looking very useful but it’s still observable but it’s not a “mind” like an AGI. To add to your comments, I suggest that local vector store of embedding vectors of local content is how I’m going with memory issue. Langchain like. That way all previous progress is tracked and retrievable. That way the system can retrieve all it’s “memories” itself. The recursive multi agent pattern is big deal in my opinion.
- basch 4y agolay*
- pmoriarty 4y agoLangchain[1] can be used to add memory to an LLM. [1] - https://www.pinecone.io/learn/langchain-conversational-memory/ https://www.pinecone.io/learn/langchain-conversational-memor...