Is that paper discussing LLMs though? That some sort of neural network can be trained to perform maths doesn't seem surprising and I would expect eventually it'

Is that paper discussing LLMs though? That some sort of neural network can be trained to perform maths doesn't seem surprising and I would expect eventually it'll be a standard expectation they can do so even without being fed masses of training data (ideally no more than a human needs). It's the path from ChatGPT-4 to such a network I'm curious about.