3 ms·
on what metric? Why would OpenAI bother serving GPT4 if customers would be just as happy with a tiny 9B model?
by jazzyjackson 2y ago
on what metric?
Why would OpenAI bother serving GPT4 if customers would be just as happy with a tiny 9B model?
- tosh 2y agohttps://lmarena.ai/ https://lmarena.ai/ Check out the lmsys leaderboard. It has an overall ranking as well as ranking for specific categories. OpenAI are also serving gpt4o mini. That said afaiu it’s not known how large/small mini is. Being more useful than GPT3.5 is not a high bar anymore.
- simonw 2y agoDon't confuse GPT-4 and GPT-4o. GPT-4o is a much better experience than the smaller local models. You can see that in the lmarena benchmarks or from trying them out yourself.