3 ms·
Inference costs have in fact been crashing, going from astronomical to... lower. That said, I am not sure that this indicator alone tells the whole story, if n
by renegade-otter 10mo ago
Inference costs have in fact been crashing, going from astronomical to... lower.
That said, I am not sure that this indicator alone tells the whole story, if not hides it - sort of like EBITDA.
- Kuinox 10mo agoI think there will still be cheap inference, what will rise in costs will be frontier model subscriptions. This is the thing that is not profitable.