Didn't it just get better at next token prediction? I don't think anything emerged in the model itself, what was surprising is how really good next token predic

Didn't it just get better at next token prediction? I don't think anything emerged in the model itself, what was surprising is how really good next token prediction itself is at predicting all kind of other things no?