3 ms·
It isn't on the benchmark https://www.swebench.com/#verified https://www.swebench.com/#verified The one on the official leaderboard is the 63% score. Presumabl
by ianbutler 2y ago
It isn't on the benchmark https://www.swebench.com/#verified https://www.swebench.com/#verified
The one on the official leaderboard is the 63% score. Presumably because of all the extra work they had to do for the 70% score.