4 ms·
If one is to believe the API prices are reasonable representation of non subsidized "real world pricing" (with model training being the big exception), then the
by adi_kurian 7mo ago
If one is to believe the API prices are reasonable representation of non subsidized "real world pricing" (with model training being the big exception), then the models are getting cheaper over time. GPT 4.5 was $150.00 / 1M tokens IIRC. GPT o1-pro was $600 / 1M tokens.
- vonneumannstan 7mo agoYou can check the hardware costs for self hosting a high end open source model and compare that to the tiers available from the big providers. Pretty hard to believe its not massively subsidized. 2 years of Claude Max costs you 2,400. There is no hardware/model combination that gets you close to that price for that level of performance.
- adi_kurian 7mo agoYes that's why I said API price. I once used the API like I use my subscription and it was an eye watering bill. More than that 2 year price in... a very short amount of time. With no automations/openclaw.
- lostmsu 6mo agoAre you considering batch inference?