3 ms·
But, by the looks of things, models will be more efficient by then and a cheaper-to-run model will produce comparable output. At least that's how it's been with
by ojosilva 1y ago
But, by the looks of things, models will be more efficient by then and a cheaper-to-run model will produce comparable output. At least that's how it's been with OSS models, or with the Openai api model. So maybe the inevitable price hike (or rate limiting) may lead to switching models / providers and the results being just as good.
- krainboltgreene 1y ago> But, by the looks of things, models will be more efficient by then and a cheaper-to-run model will produce comparable output So far there's negative evidence of this. Things are getting more expensive for similar outputs.
- etoxin 1y agoAnd this varies widely between models based on how they are told to reason.
- racc1337 1y agoThere is an interesting substack post about this. LLM costs are dropping 10x/year but the amount of tokens used have gone up like crazy https://open.substack.com/pub/ethanding/p/ai-subscriptions-get-short-squeezed?r=6e7vnk&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false https://open.substack.com/pub/ethanding/p/ai-subscriptions-g...