3 ms·
Subjectively I find Kimi is far "smarter" than the benchmarks imply, maybe because they game then less than US labs
by nylonstrung 11mo ago
Subjectively I find Kimi is far "smarter" than the benchmarks imply, maybe because they game then less than US labs
- rubymamis 11mo agoMy impression as well!
- vessenes 11mo agoI like Kimi too, but they definitely have some benchmark contamination: the blog post shows a substantial comparative drop in swebench verified vs open tests. I throw no shade - releasing these open weights is a service to humanity; really amazing.