4 ms·
The will not measure up. Notice they're comparing it to Gemma, Google's open weight model, not to Gemini, Sonnet, or GPT. That's fine - this is a tiny model. I
by vidarh 7mo ago
The will not measure up. Notice they're comparing it to Gemma, Google's open weight model, not to Gemini, Sonnet, or GPT. That's fine - this is a tiny model.
If you want something closer to the frontier models, Qwen3.6-Plus (not open) is doing quite well[1] (I've not tested it extensively personally):
https://qwen.ai/blog?id=qwen3.6 https://qwen.ai/blog?id=qwen3.6
- pzo 7mo agoon the bright side also worth to keep in mind those tiny models are better than GPT 4.0, 4.1 GPT4o that we used to enjoy less than 2 years ago [1] [1] https://artificialanalysis.ai/?models=gpt-5-4%2Cgpt-oss-120b%2Cgpt-oss-20b%2Cgpt-5-4-mini%2Cgpt-5-4-pro%2Cgemma-4-26b-a4b%2Cgemini-3-flash-reasoning%2Cgemma-4-31b%2Cgemini-3-1-pro-preview%2Cgemini-3-1-flash-lite-preview%2Cclaude-sonnet-4-6-adaptive%2Cclaude-opus-4-6-adaptive%2Cclaude-4-5-haiku-reasoning%2Cdeepseek-v3-2-reasoning%2Cminimax-m2-7%2Cglm-5-1%2Cqwen3-5-35b-a3b%2Cqwen3-5-27b%2Cgpt-4o%2Cgpt-4-1 https://artificialanalysis.ai/?models=gpt-5-4%2Cgpt-oss-120b...
- vidarh 7mo agoThey're absolutely worth using for the right tasks. It's hard to go back to GPT4 level for everything (for me at least), but there's plenty of stuff they are smart enough for.