4 ms·
The current LLM models are too fallible and inefficient for everyday use. Energy requirements have become a major concern, bucking the trend of banking exponent
by pardon_me 11mo ago
The current LLM models are too fallible and inefficient for everyday use. Energy requirements have become a major concern, bucking the trend of banking exponential computing gains through the efficiency improvements. Until recently, year-on-year global energy demands of data-centers were increasing linearly despite the exponential increase in computing power.
This has changed since the cost of equipment and infrastructure has been close to "free" for the large corporations running a cycle of funny-money investment in a bubble. This has allowed them sell access to the computing and models for just above operational energy costs (to the extent of increasing global energy prices), whilst offering free accounts to harvest data. No small competitor could possibly compete with that model.
The calculation for profitability (useful output for humans in a cost-benefit analysis) of the current setup is broken, and trades on our dreams of the future. Scaling computing forever simply does not work. It will never be profitable without further leaps forward in the technology--either more efficient models or hardware. By this time, the extent to the excessive investment in new data-centers will be clear.