3 ms·
If I were to speculate, OpenAI is doing two types of optimizations: 1) Cost 2) Function I suspect ChatGPT is 90% a cost-optimized version of GPT3, and 10% a
by frognumber 4y ago
If I were to speculate, OpenAI is doing two types of optimizations:
1) Cost
2) Function
I suspect ChatGPT is 90% a cost-optimized version of GPT3, and 10% a function-enhanced one.
GPT3 was the first major public wow-able model, and I suspect it was not running on any sort of optimized infrastructure.
- TideAd 4y agoyeah there is no way they'd want that kind of traffic unless the expense knobs were turned down. you might have 10 million queries on this thing per day. if it's just 1c/query that's already $100k/day.