3 ms·
Unlike Bitcoin, which burns more energy for the same usage as the price goes up, LLM inference prices are dropping rapidly [1] because AI companies have big inc
by skybrian 1y ago
Unlike Bitcoin, which burns more energy for the same usage as the price goes up, LLM inference prices are dropping rapidly [1] because AI companies have big incentives to cut costs.
Companies like Apple and Google are both building data centers and trying to make on-device AI a thing. Unfortunately, they also keep inventing new, more expensive algorithms.
It’s at least plausible that most LLM use will become cheap enough to run on battery-limited devices like laptops and phones, though it’s not what most people are betting on.
[1] https://epoch.ai/data-insights/llm-inference-price-trends https://epoch.ai/data-insights/llm-inference-price-trends