3 ms·
Except that the content already exists and there is no cost to maintain it. If GPT incurred a non negligible cost on the content owners by accessing their reso
by ta988 3y ago
Except that the content already exists and there is no cost to maintain it.
If GPT incurred a non negligible cost on the content owners by accessing their resources it may have been different but that's not the case.
The only thing that content owners may be able to complain about is that potentially ChatGPT/DallE may reduce their potential income and this would have to be proven. I have not stopped buying books or art of any kind since I use ChatGPT/DallE. And low quality automated content producers existed before OpenAI and were already diluting the attention to more carefully produced content (as can be seen with videos on youtube).
- xiphias2 3y agoIt seems like you have no idea how much effort it takes to write a book. Quite often it contains the experience of a life of a person condensed to a few hundred pages. ChatGPT gives easier access to the knowledge contained in tens of thousands of these books. As for me I have been reading less and less books as more wisdom is accessable on the internet in better forms (now GPT). I'm not against what OpenAI is doing as it moves humanity forward, but like you said I won't stop using ChatGPT just because ByteDance scrapes it.
- dougb5 3y agoThat's great to hear that there's no cost to maintaining content! I'll tell AWS they've been overcharging me :)
- ta988 3y agoNot what I am saying. I am saying it is much much smaller than inference/model running cost. Easy exercise How many books do you store in 1GB How much does it cost a year to store it and have OpenAI gather it once. How much does it cost to run a GPT4 level model that will output 1GB. That's my point here that's all. It is a huge cost for OpenAI to run a system that produces dynamic content. And it is not comparable to the cost of storing static content. I didn't talk about the cost of producing the original data. And I do not talk about training costs.
- dougb5 3y agoSure, but your comment said "maintain", not "store". Even if storage were free, and even if you discount the value of the initial creation to zero, there are still nontrivial serving costs associated with many sites. What I share with people on the Web may look like a static byte sequence to the robots consuming it, but it takes a lot of work to compute those bytes (in the moment, I mean). Aggregated over the whole web, no, that is not smaller than OpenAI's expenditures.
- leereeves 3y agoIf cost is your primary concern, shouldn't you support ByteDance's efforts to reduce inference costs by distilling the model? (while at the same time reducing future costs for everyone by distributing the capability more widely to prevent monopolization)
- ta988 3y agoAt no point I said I did not support that.