4 ms·
That's great to hear that there's no cost to maintaining content! I'll tell AWS they've been overcharging me :)
by dougb5 3y ago
That's great to hear that there's no cost to maintaining content! I'll tell AWS they've been overcharging me :)
- ta988 3y agoNot what I am saying. I am saying it is much much smaller than inference/model running cost. Easy exercise How many books do you store in 1GB How much does it cost a year to store it and have OpenAI gather it once. How much does it cost to run a GPT4 level model that will output 1GB. That's my point here that's all. It is a huge cost for OpenAI to run a system that produces dynamic content. And it is not comparable to the cost of storing static content. I didn't talk about the cost of producing the original data. And I do not talk about training costs.
- dougb5 3y agoSure, but your comment said "maintain", not "store". Even if storage were free, and even if you discount the value of the initial creation to zero, there are still nontrivial serving costs associated with many sites. What I share with people on the Web may look like a static byte sequence to the robots consuming it, but it takes a lot of work to compute those bytes (in the moment, I mean). Aggregated over the whole web, no, that is not smaller than OpenAI's expenditures.
- leereeves 3y agoIf cost is your primary concern, shouldn't you support ByteDance's efforts to reduce inference costs by distilling the model? (while at the same time reducing future costs for everyone by distributing the capability more widely to prevent monopolization)
- ta988 3y agoAt no point I said I did not support that.