4 ms·
Added Qwen3 Next to the Brokk Power Ranking Open Round (coding benchmark). It's roughly GPT-OSS-20b strength. Full set of open weight model results: https://br
by jbellis 1y ago
Added Qwen3 Next to the Brokk Power Ranking Open Round (coding benchmark). It's roughly GPT-OSS-20b strength.
Full set of open weight model results: https://brokk.ai/power-ranking?version=openround&models=ds-r1.1%2Cds-v3.1%2Cglm4.5%2Cglm4.5-air%2Cgpt-oss-120b%2Cgpt-oss-20b%2Ck2%2Cq3c%2Cq3c-fp8%2Cq3next%2Cr1%2Cv3 https://brokk.ai/power-ranking?version=openround&models=ds-r...
- noahbp 1y agoIs that the updated Kimi K2, or the old Kimi k2?
- jbellis 1y agoIt's the original. I'll update the label to clarify.
- SparkyMcUnicorn 1y agoThis would be a valuable benchmark if it included languages other than Java, and let me see which models are best at the languages I work with. My real-world usage does not line up with these results, but I'm not working with Java.