3 ms·
Openai charges per token of input, a summarizing service where you feed it large amounts of input would have lousy economics.
by sbierwagen 4y ago
Openai charges per token of input, a summarizing service where you feed it large amounts of input would have lousy economics.
- langsoul-com 4y agoIsn't the economics of all chatgpt related products just charging more than they paid for use?
- sbierwagen 4y agoImagine the following scenario: If you're a wrapper around ChatGPT, summarizing ten thousand tokens costs $100. If you use an in-house net, it costs you $1 of GPU time. Is $100 larger than $1? Think it through step by step. Show your work.