3 ms·
Training you mean. Doing inference on last year's chip is probably ok, but training a frontier model on it is going to be a deal breaker.
by trick-or-treat 7mo ago
Training you mean. Doing inference on last year's chip is probably ok, but training a frontier model on it is going to be a deal breaker.
- KeplerBoy 7mo agoNo I mean inference. The idea is that inference demand will be massive and a race to the bottom with razor thin margins. Training costs can be amortized over the entire lifetime of the model, but if you lose money on inference or can't offer competitive usage limits for subscribers, there's no amortizing that.
- trick-or-treat 7mo agoNo it's all about having the top model first and training time is what's crucial. OpenAI has already shown willingness to bleed money for the sake of brand and we can expect that to continue.
- KeplerBoy 7mo agoOpenAI economics don't really work unless you happen to be OpenAI.