4 ms·
> Even GPT-3 knows nothing about the real world; it's merely trained to repeat the words that most often followed the prompt in its training data. I don't know
by FeepingCreature 6y ago
> Even GPT-3 knows nothing about the real world; it's merely trained to repeat the words that most often followed the prompt in its training data.
I don't know why that would imply that it knows nothing about the real world, unless the data corpus it is trained on likewise bears no relation to reality...
- nmfisher 6y ago> unless the data corpus it is trained on likewise bears no relation to reality It’s trained on Reddit, so I wouldn’t rule that out.