3 ms·
The fact that the post singled out SWE-bench at the top makes the opposite impression that they probably intended.
by GodelNumbering 11mo ago
The fact that the post singled out SWE-bench at the top makes the opposite impression that they probably intended.
- grantpitt 11mo agodo say more
- GodelNumbering 11mo agoMakes it sound like a one trick pony
- grantpitt 11mo agowell, it's a big trick
- jascha_eng 11mo agoAnthropic is leaning into agentic coding and heavily so. It makes sense to use swe verified as their main benchmark. It is also the one benchmark Google did not get the top spot last week. Claude remains king that's all that matters here.
- Mkengin 11mo agoI am eagerly awaiting swe-rebench results for November with all the new models: https://swe-rebench.com/ https://swe-rebench.com/