4 ms·
Even GPT-3 knows nothing about the real world; it's merely trained to repeat the words that most often followed the prompt in its training data. That's obviousl
by leereeves 6y ago
Even GPT-3 knows nothing about the real world; it's merely trained to repeat the words that most often followed the prompt in its training data. That's obviously not useful for news...if a fact is in the training data, it's not news. It's not useful for "hard facts about how your pension fund is performing" unless you want to know how it performed a long time ago.
But I agree there are some applications it is useful for, like education.
- FeepingCreature 6y ago> Even GPT-3 knows nothing about the real world; it's merely trained to repeat the words that most often followed the prompt in its training data. I don't know why that would imply that it knows nothing about the real world, unless the data corpus it is trained on likewise bears no relation to reality...
- nmfisher 6y ago> unless the data corpus it is trained on likewise bears no relation to reality It’s trained on Reddit, so I wouldn’t rule that out.