3 ms·
Your reply is mostly a red herring because as you yourself said, the OP was talking about regular training data, not the ICL you focused on. Just because you c
by FartyMcFarter 4y ago
Your reply is mostly a red herring because as you yourself said, the OP was talking about regular training data, not the ICL you focused on.
Just because you can find one way that GPT might be slow doesn't invalidate the point that its training does use massive amounts of data.
- i_like_apis 4y agoSo what if it does?
- visarga 4y agoIf GPT-3 can learn in context it means both the training set and the prompt could be in copyright violation. So even a clean model, trained on licensed data, cannot guarantee there will be no copyright issue.