We don’t have to imagine GPT3 doesn’t understand maths. It can reliably answer 1+1= because there are so many instances of it in the corpus, but if you give any

We don’t have to imagine GPT3 doesn’t understand maths. It can reliably answer 1+1= because there are so many instances of it in the corpus, but if you give anything more complicated it will just throw out a random, incorrect, answer in most cases.