4 ms·
Something I just realized here is that ChatGPT seems to be the first time that users are able to "teach" the model in a similar way that we teach other people.
by dnadler 4y ago
Something I just realized here is that ChatGPT seems to be the first time that users are able to "teach" the model in a similar way that we teach other people.
Maybe "teach" isn't the right word, as the model isn't updating its parameters AFAIK. Perhaps "guide" is better.
If there's a way for ChatGPT to update its weights based on these conversations, things could get really interesting.
- FeepingCreature 4y agoI believe this is just an elaboration on few-shot/one-shot learning, which was first observed in GPT-3: https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165 The novelty in ChatGPT is that it is trained to respond to few-shot learning in the form of a dialog.