4 ms·
Surprised to see every chart limited to comparisons against other OpenAI models. What does the industry comparison look like?
by smoody07 7mo ago
Surprised to see every chart limited to comparisons against other OpenAI models. What does the industry comparison look like?
- aydyn 7mo agoThey compare to Claude and Gemini in their tweet
- 0123456789ABCDE 7mo agohttps://artificialanalysis.ai https://artificialanalysis.ai should have the numbers soon
- lorenzoguerra 7mo agoI believe that this choice is due to two main reasons. First, it's (obviously) a marketing strategy to keep the spotlight on their own models, showing they're constantly improving and avoiding validating competitors. Second, since the community knows that static benchmarks are unreliable, it makes sense for them to outsource the comparisons to independent leaderboards, which lets them avoid accusations of cherry-picking while justifying their marketing strategy. Ultimately, the people actually interested in the performance of these models already don't trust self-reported comparisons and wait for third-party analysis anyway
- throwaway911282 7mo agohttps://xcancel.com/OpenAI/status/2029620619743219811 https://xcancel.com/OpenAI/status/2029620619743219811 you can see comparisons here