3 ms·
Has there been any announcement of a new programming benchmark? SWE looks like it's close to saturation already. At this point for SWE it may be more interestin
by viraptor 11mo ago
Has there been any announcement of a new programming benchmark? SWE looks like it's close to saturation already. At this point for SWE it may be more interesting to start looking at which types of issues consistently fail/work between model families.
- Mkengin 11mo agoI like this one: https://swe-rebench.com/ https://swe-rebench.com/