3 ms·
My own usage and the usage of pretty much everyone I know says that as inference costs drop, usage goes up in lockstep, and I’m still nowhere near the ceiling o
by Analemma_ 1y ago
My own usage and the usage of pretty much everyone I know says that as inference costs drop, usage goes up in lockstep, and I’m still nowhere near the ceiling of how many tokens I could use if they were free.
I think if these companies are gambling their future on COGS going down, that’s a gamble they’re going to lose.
- delaminator 1y agoaka Jevons Paradox. we strive to make machines more efficient to reduce energy usage. That makes $ per unit of work lower. But instead of reducing spending, people find more uses for the machines.