3 ms·
With some back of the napkin math, I am pretty sure you're off by at least two orders of magnitude, conceivably 4. I think 2 cents per video is an upper limit.
by dwohnitmok 1y ago
With some back of the napkin math, I am pretty sure you're off by at least two orders of magnitude, conceivably 4. I think 2 cents per video is an upper limit.
https://news.ycombinator.com/item?id=45434298 https://news.ycombinator.com/item?id=45434298
Generally speaking, API costs that the consumer sees are way higher than compute costs that the provider pays.
EDIT: Upper limit on pure on-going compute cost. If you factor in chip capital costs as another commentator on the other thread pointed out, you might add another order of magnitude.
- rafram 1y agoYou also aren’t including amortized training costs, which are immense (and likely ongoing as they continue to tweak the model).
- dwohnitmok 1y agoI suspect amortized training costs are only a relatively small fraction of the amortized hardware costs (i.e. counting amortized hardware costs already accounts for the large fraction of the cost of training and pulling out training as a completely separate category double counts a lot of the cost).