2 ms·
It would mean that inference is not profitable. Calculating inference costs show it's profitable, or close to.
by Kuinox 9mo ago
It would mean that inference is not profitable.
Calculating inference costs show it's profitable, or close to.
- renegade-otter 9mo agoInference costs have in fact been crashing, going from astronomical to... lower. That said, I am not sure that this indicator alone tells the whole story, if not hides it - sort of like EBITDA.
- Kuinox 9mo agoI think there will still be cheap inference, what will rise in costs will be frontier model subscriptions. This is the thing that is not profitable.