3 ms·
They have… they write language and they are good at it. The problem is language is not reality, proper language does not mean truth or fact. The models predict
by bitnasty 3y ago
They have… they write language and they are good at it. The problem is language is not reality, proper language does not mean truth or fact. The models predict what is most likely to come next, not what is most likely to reflect reality.
- nomel 3y ago> what is most likely to come next > not what is most likely to reflect reality. Shouldn't there be a strong statistical correlation between the two? And, isn't that, fundamentally, more about intent of the training? If I train a model to predict what comes next in reality, it's through next word prediction, but it is predicting what reflects reality the best.