"...evidence that we may have reached a phase of diminishing returns" With the current crop of LLMs, yes. With such AI models in general, no. We need to extend

"...evidence that we may have reached a phase of diminishing returns" With the current crop of LLMs, yes. With such AI models in general, no. We need to extend their capabilities in different directions. Just as an example: one analysis I read, pointed out that the current LLMs live in a one-dimensional world. Everything is just a sequential string of tokens. Think of a Turing machine, writing on a tape. Sure, theoretically it can perform any computation. Practically? Not so useful. We need new ways of introducing context and knowledge into AI models. Their conversations may be one-dimensional (as, indeed, ours are), but they need another dimension to provide reasoning and depth.