3 ms·
We do know that our brain changes, and we equally know that ChatGPT does not. If it were able to modify it’s own model, and permanently execute on itself I’d b
by Aeolun 4y ago
We do know that our brain changes, and we equally know that ChatGPT does not.
If it were able to modify it’s own model, and permanently execute on itself I’d be a lot more worried.
- pixl97 4y agoWe cannot do that today, but how many days is that away? Is it measured in the hundreds, the thousands, or more? I feel we're uncomfortably close to the days of the self modifing learning models.
- sdenton4 4y agoChat gpt changes when we train or fine-tune it. It also has access to local context within a conversation, and those conversations can be fed back as more training data. This is similar to a hard divide between short term and long term learning.
- abra0 4y agoGPT-4 has 32k tokens of context. I'm sure someone out there is implementing the pipework for it to use some as a scratchpad under its own control, in addition to its input. In the biological metaphor, that would be individual memory, in addition to the species level evolution through fine-tuning
- Aeolun 4y agoYeah, I’m doing that to get GPT-3.5 to remember historical events from other conversations. It never occurred to me to let it write it’s own memory, but that’s a pretty interesting idea.