3 ms·
That paper is about the training process, though. None of it applies to anything novel you type into the ChatGPT prompt. The end product is a totally static equ
by Miraste 4y ago
That paper is about the training process, though. None of it applies to anything novel you type into the ChatGPT prompt. The end product is a totally static equation until OpenAI updates it.
- redox99 4y agoGPT3 very own paper, "Language Models are Few Shot Learners"[1] show otherwise [1] https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165
- Miraste 4y agoWe're getting into semantics now, but that paper doesn't show learning. GPT can mimic learning capabilities through pattern recognition, but it works by feeding multiple past prompts in as one aggregate. If you show it examples, then go over the token limit (I believe it's 2048), it will "forget" its novel capabilities, because although the paper calls it few-shot learning, the text input is always zero-shot. All the past prompts are fed in again with every new message. The model stays static.