3 ms·
Compute capacity for the same workload always gets cheaper over time.
by nradov 7mo ago
Compute capacity for the same workload always gets cheaper over time.
- jclulow 7mo agoNo piece of compute capacity (in the form of equipment) I have bought this year has been in any way cheaper than last year.
- nradov 7mo agoSo what. Fluctuations over a year or two are meaningless. Do you really believe that the constant-dollar price of an LLM token will be higher in 20 years?
- edmundsauto 7mo agoI can see a world where energy costs rise at a rate faster than overall inflation, or are a leading indicator. In that scenario then yes I could see LLM token costs going up.