When coding they are solving "novel, unsolved problems" related to coding problems set up. So I will assume you mean within maths, science etc? Basically thing

When coding they are solving "novel, unsolved problems" related to coding problems set up. So I will assume you mean within maths, science etc? Basically things they can't solve today. Well 99.9% of humans cannot solve novel, unsolved problems in those fields. LLMs cannot learn, there is just the initial weight estimation process. And that process currently does not make them good enough on novel math/theoretical physics problems. That does not mean they do not "reason" in the same way that those 99.9% of humans still "reason". But they definitely do not learn, the way humans do. (Anyway, if LLMs could somehow get 1000x as large context window and get to converse with themselves for a full year, it does not seem out of the question they could come out with novel research?)