I think it's premature to be integrating LLMs into operating systems. That said I think they're very valuable, and the training is fundamental research. I feel

I think it's premature to be integrating LLMs into operating systems. That said I think they're very valuable, and the training is fundamental research. I feel like complaining about the resources used to train new models is a bit like complaining about the resources used to build experimental fusion reactors or particle accelerators. The fact that we're seeing direct applications is a bonus, but it's still more like fundamental research than anything. People are spending all that money training because they are trying to fix the problems you're complaining about, and this includes fixing the power consumption problem. If we can create 3B parameter models that have capabilities on par with today's 405B parameter models, that's worth spending a lot of energy training. But nobody knows what is possible, so they have to try. I feel like you're basically arguing nobody should try because you don't believe they will ever improve, but that seems contradicted by the general trajectory of how things have been working the past decade. More resources spent on training means more efficient and useful models.