I don't agree. Besides the fact that I can't do much math either, except with a lot of effort and tools, at this point there are masses of examples of GPTs doin

I don't agree. Besides the fact that I can't do much math either, except with a lot of effort and tools, at this point there are masses of examples of GPTs doing basic reasoning and logic and solving problems. Of course you can say that they do it by "finding the most probable continuation"- and you're right. But that doesn't change the fact that it works. Simply because to find the most probable continuation ultimately you need semantic understanding, and somewhere, back-propagating from the training text, the NNs have managed to build a decent model of the world. There's no other way to explain their performance, these are not markov chain text generators.