3 ms·
Why do you think OpenAI wanted to get rid of GPT-4 etc so aggressively? I suppose there's a distinction between new less capable models, I can see why those wo
by jjfoooo4 1y ago
Why do you think OpenAI wanted to get rid of GPT-4 etc so aggressively?
I suppose there's a distinction between new less capable models, I can see why those would be more efficient. But maybe the older frontier models are less efficient to serve?
- simonw 1y agoDefinitely less efficient to serve. They used to charge $60/million input tokens for GPT-3 Da Vinci. They charge $1.25/million for GPT-5. Plus I believe they have to keep each model in GPU memory to serve it, which means that any GPU serving an older model is unavailable to serve the newer ones.