3 ms·
Not sure why they don't compare with others, but they are actually leading on the benchmarks they published. See here (bottom) for a chart comparing to other mo
by qwesr123 10mo ago
Not sure why they don't compare with others, but they are actually leading on the benchmarks they published. See here (bottom) for a chart comparing to other models: https://marginlab.ai/blog/swe-bench-deep-dive/ https://marginlab.ai/blog/swe-bench-deep-dive/
- mistercheph 10mo agoIt's like apple, they just don't want users or anyone to even be thinking of their competitors, the competition doesn't exist, it's not relevant.
- whimsicalism 10mo agois swe-bench saturated? or they switch to swe-bench pro because...?
- Mkengin 10mo agoAt least on swe-rebench it does pretty well: https://swe-rebench.com/ https://swe-rebench.com/