2 ms·
That's what the post means. OpenAI doesn't lose money on each request but rather gains it. To recuperate the fixed costs in R&D.
by simianwords 1y ago
That's what the post means. OpenAI doesn't lose money on each request but rather gains it. To recuperate the fixed costs in R&D.
- lelanthran 1y ago> OpenAI doesn't lose money on each request but rather gains it. To recuperate the fixed costs in R&D. Right, but that is why I used the word "amortise"; there is only a limited time to recuperate that cost. If you spend $120 in training, and it takes 6 months for the next SOTA to drop from a competitor, you have to make clear $10/m after inference costs.