But software engineering is almost certainly the best possible application for LLMs, because there is an immense amount of training data. What training does it

But software engineering is almost certainly the best possible application for LLMs, because there is an immense amount of training data. What training does it have for therapy? Reddit? Egads ;-) Personally I think we are at the top of the S-curve for this technology. And I suspect a lot of what we see as major recent advances are attributable to improved harnesses as much as any improvement in the abilities of the models. My guess is we will see only minor improvements going forward in the frontier models (barring a major new discovery) and major improvements in smaller models. IMO that is where the real impact will be felt day-to-day, when we can run fairly powerful LLMs in all sorts of places without having to make API calls to huge GPU clusters in the cloud.