3 ms·
Interesting how Sonnet has a higher SWE-bench Verified score than Opus. Maybe says something about scaling laws.
by oofbaroomf 1y ago
Interesting how Sonnet has a higher SWE-bench Verified score than Opus. Maybe says something about scaling laws.
- somebodythere 1y agoMy guess is that they did RLVR post-training for SWE tasks, and a smaller model can undergo more RL steps for the same amount of computation.
- benoittravers 1y agoDo you have the link to that benchmark? Can’t see where Sonnet is highlighted.