2 ms·
Not perfect, but I find the artificialanalysis.ai "Intelligence vs. Output Tokens Used in Artificial Analysis Intelligence Index" chart[0] (scroll down to the t
by karmakaze 5mo ago
Not perfect, but I find the artificialanalysis.ai "Intelligence vs. Output Tokens Used in Artificial Analysis Intelligence Index" chart[0] (scroll down to the titled chart) to be of great use. A proper evaluation needs to compare 3 things together: score, speed, and verbosity. This chart plots score vs verbosity.
[0] https://artificialanalysis.ai/?models=gpt-oss-120b%2Cgemma-4-26b-a4b%2Cgemma-4-31b%2Cdeepseek-v4-pro-high%2Cdeepseek-v4-flash%2Cdeepseek-v4-pro%2Cdeepseek-v4-flash-high%2Cminimax-m2-7%2Ckimi-k2-6%2Cglm-5-1%2Cqwen3-6-35b-a3b%2Cqwen3-6-27b%2Cqwen3-5-122b-a10b%2Cqwen3-6-plus&intelligence-efficiency=intelligence-efficiency-vs-output-tokens&model-creators=openai%2Cgoogle%2Cdeepseek%2Cminimax%2Ckimi%2Calibaba https://artificialanalysis.ai/?models=gpt-oss-120b%2Cgemma-4...