5 ms·
> They don't comprehend the meaning of the patterns (as best I have come to understand it from reading news). It is not obvious to me that this is true. The a
by Version467 3y ago
> They don't comprehend the meaning of the patterns (as best I have come to understand it from reading news).
It is not obvious to me that this is true.
The argument against this is that a model has to develop an abstract understanding of the world in order to get better at predicting the next token.
You'll find different opinions as to wether this happens with todays llm's, but it's definitely not a clear cut issue.
- ankurdhama 3y ago> The argument against this is that a model has to develop an abstract understanding of the world in order to get better at predicting the next token. I think they only develop abstract understanding about the relationships of the words/group of words.