3 ms·
Training amortises over countless inferences. And inference isn't all that expensive, because the cost of the graphics card also amortises over countless infer
by eru 2y ago
Training amortises over countless inferences.
And inference isn't all that expensive, because the cost of the graphics card also amortises over countless inferences.
Human labour is really expensive.
See https://help.openai.com/en/articles/7127956-how-much-does-gpt-4-cost https://help.openai.com/en/articles/7127956-how-much-does-gp... and compare with how much it would cost to pay a human. We can likely assume that the prices OpenAI gives will at least cover their marginal cost.