4 ms·
I was listening to a podcast[1] and they say the cost of inference (responding to a question) in ChatGPT is about 1-2 cent. Is that true? And how would that map
by firstSpeaker 4y ago
I was listening to a podcast[1] and they say the cost of inference (responding to a question) in ChatGPT is about 1-2 cent. Is that true? And how would that map to the overall cost microsoft can pay for integrating that into Bing, considering number of search queries in Bing.
1- https://www.nytimes.com/2023/01/06/podcasts/hard-fork-tiktok-microsoft-chatgpt.html https://www.nytimes.com/2023/01/06/podcasts/hard-fork-tiktok...
- frozencell 4y agoJust for most active searchers maybe.
- suby 4y agohttps://twitter.com/elonmusk/status/1599669552081960960 https://twitter.com/elonmusk/status/1599669552081960960 Elon Musk: What's the average cost per chat? Sam Altman: average is probably single-digits cents per chat; trying to figure out more precisely and also how we can optimize it -- Though I am not sure what per chat really means here. Per message?