4 ms·
I do wonder what is the real economic cost of running a ChatGPT query, once you peel away any introductory pricing etc. IE amortised cost of hardware and resear
by rich_sasha 4y ago
I do wonder what is the real economic cost of running a ChatGPT query, once you peel away any introductory pricing etc. IE amortised cost of hardware and research, plus running costs (electricity).
Whenever I see the size of these models, it strikes me that it must be quite a bit, certainly not pennies.
- xiphias2 4y agoIn the all in podcast they said 30 cents / query (probably for the original version), and 1-3 cents for Google search, that’s why what Bing is doing can be so disrupting to Google margins as well when they introduce it.