3 ms·
Where do you see the major price increases coming from? The underlying inference is not super expensive. All the tricks they're pulling to make it smarter cert
by barrkel 1y ago
Where do you see the major price increases coming from?
The underlying inference is not super expensive. All the tricks they're pulling to make it smarter certainly multiply the price, but the price being charged almost certainly covers the cost. Basic inference on tuned base models is extremely cheap. But certainly it looks like Anthropic > OpenAI > Google in terms of inference cost structure.
Prices will only come up if there's a profit opportunity; if one of the vendors has a clear edge and gains substantial pricing power. I don't think that's clear at this point. This article is already equivocating between o3 and Opus.