I don't think LLMs are going to change it as much as the massive concurrency that modern hardware provides. A single threaded task can only reach a tiny fractio

I don't think LLMs are going to change it as much as the massive concurrency that modern hardware provides. A single threaded task can only reach a tiny fraction of the CPU resources in a machine these days.