3 ms·
> Without permanent changes to its weights, the use of the term learning stretches the word beyond utility. Yes, my claim is that there is nothing that makes i
by whimsicalism 6y ago
> Without permanent changes to its weights, the use of the term learning stretches the word beyond utility.
Yes, my claim is that there is nothing that makes its weights incapable of being fine-tuned and thus changed.
- Cybiote 6y agoOh okay, then in that case we don't disagree and are talking about different things. My issue is the few shot learning done by a model which is performing gradient updates should be distinguished from whatever GPT-3 is doing when it's continuing context patterns.