> The argument against this is that a model has to develop an abstract understanding of the world in order to get better at predicting the next token. I think

> The argument against this is that a model has to develop an abstract understanding of the world in order to get better at predicting the next token. I think they only develop abstract understanding about the relationships of the words/group of words.