11 ms·
I'm waiting for a general correction mechanism, I don't even know what to call it. "NO, chatgpt, people usually have 5 fingers", and the gpt just learns, rathe
by xen2xen1 4y ago
I'm waiting for a general correction mechanism, I don't even know what to call it. "NO, chatgpt, people usually have 5 fingers", and the gpt just learns, rather like a child. I keep thinking that's the next real step.
- jacooper 4y agoI think what's mainly stopping that from happening is that GPT-4 doesn't remember older chats. If we make it remember everything ,it should get more personal and remember everything right?
- valine 4y agoThe token limit is the problem, in general token limits can’t be changed after the model has been trained. Gpt4 has an exceptionally large 32k token limit, but even with 32k tokens you’d only get a few weeks of chat before the context window was full. Not to mention the added cost of using the full 32k tokens. OpenAI is charging $0.12 a token which would quickly add up. It’s prohibitively expensive unless you have a very very compelling business use case.
- jacooper 4y agoMaybe trim chat history to most important content?
- dragonwriter 4y agoThe problem is that, to the extent the analogy of ChatGPT to a living thing makes sense, the individual isn’t the model (that's just the common species-defining—or maybe “clone family” is better than “species”—set of instincts), the individual lifespan is the conversation. You could share feedback across conversations by allocating prompt space to it, at the expense of limiting the size of the conversation, but you'd need a way to decide what to share this way.
- valine 4y agoYou could also take the conversation and use it as part of the reinforcement learning dataset. I feel like that's the closest thing to long term memory ChatGPT is capable of right now.