4 ms·
why would chip affect token quantity. this is all models.
by swyx 6mo ago
why would chip affect token quantity. this is all models.
- louiereederson 6mo agoChip costs strongly impact the economics of model serving. It is entirely plausible to me that Opus 4.7 is designed to consume more tokens in order to artificially reduce the API cost/token, thereby obscuring the true operating cost of the model. I agree though, I chose poor phrasing originally. Better to say that GB200 vs Tranium could contribute to the efficiency differential.
- itemize123 6mo agoprobably the wrong take - they are arm racing to a better model. it's not enshittification era for models just yet
- fiatpandas 6mo agoModels are still in arms race mode, but harnesses and subscription strategy are tiptoeing into their enshittification era.