4 ms·
6 times? My reading of these prices is that it's 45x more expensive (for 8K) and 90x more expensive (32k)
by sparrc 4y ago
6 times? My reading of these prices is that it's 45x more expensive (for 8K) and 90x more expensive (32k)
- behnamoh 4y agoThe title compares GPT3.5 (not ChatGPT) with GPT4. Although the question is: If ChatGPT can do almost anything GPT3.5 can do, then why is it priced almost 10x less? Is it because GPT3.5 is less "censored"?
- dragonwriter 4y ago> Although the question is: If ChatGPT can do almost anything GPT3.5 can do, then why is it priced almost 10x less? ChatGPT is GPT-3.5; with specific fine tuning / chat-oriented training, and without customer fine-tuning (at least, currently) available. It’s the particular GPT-3.5 interface that OpenAI wants people to preferentially use, so the price structure artificially encourages this.
- eldenring 4y agoThe ChatGPT API is using a smaller model than the original "GPT 3.5". The original, presumably larger, model is used by Legacy ChatGPT.
- behnamoh 4y agoWait is that true? I couldn't find anything that verifies this. Do you have a source? If it is in fact true, doesn't it fall into "false advertisement" category? That is, OpenAI using ChatGPT for demonstration purposes but then charging for an API that pretends to be ChatGPT but is in fact based on a much smaller model?
- wongarsu 4y agoThe normal ChatGPT interface also switched to the cheaper model, and lots of people complained when they switched (though not enough to make a big media splash). With ChatGPT Pro you can select between the new and the "Legacy" model (and now GPT4 as a third option)
- frognumber 4y agoIf I were to speculate, OpenAI is doing two types of optimizations: 1) Cost 2) Function I suspect ChatGPT is 90% a cost-optimized version of GPT3, and 10% a function-enhanced one. GPT3 was the first major public wow-able model, and I suspect it was not running on any sort of optimized infrastructure.
- TideAd 4y agoyeah there is no way they'd want that kind of traffic unless the expense knobs were turned down. you might have 10 million queries on this thing per day. if it's just 1c/query that's already $100k/day.
- rvnx 4y agoDidn't the CEO say during the GPT-4 demos that humans were involved to do the captions during all the images tests (using Be My Eyes volunteers) and that's why it took some time to show the Discord examples ? If so, it could explain some costs indirectly.
- IshKebab 4y agoWait did they just use Be My Eyes volunteers as AI labellers without telling them? Or were they told? Pretty unethical if not!
- rvnx 4y agoMaybe it's something else ? I am genuinely not sure what they mean, this is the timecode in the announcement: https://www.youtube.com/live/outcGtbnMuQ?feature=share&t=651 https://www.youtube.com/live/outcGtbnMuQ?feature=share&t=651 It seems to say that they use Be my eyes "to make the product better", so it could be humans in the loop during captioning, or maybe they are using volunteers data from Be my eyes as training set ? Or it's completely opposite, and that Be my eyes is using the OpenAI APIs ? My guess is that it is both ?
- totoglazer 4y agoNo, the opposite. GPT-4 is an “assistant” you can ask for help.
- deleted 4y ago[deleted]