What does an LLM really do? And can it create sometimes entirely novel math that goes against its training set to solve something, and know it’s right using a p

What does an LLM really do? And can it create sometimes entirely novel math that goes against its training set to solve something, and know it’s right using a proof tool that may not even accept that? I agree but on a different order of magnitude of years.