2 ms·
I posted a blog post by these guy's last year where they also claimed to have a SOTA swe-bench score in summer 2024. They seem to be reporting even better score
by zrg 1y ago
I posted a blog post by these guy's last year where they also claimed to have a SOTA swe-bench score in summer 2024. They seem to be reporting even better scores than o3. Does anyone have insight into what they are doing? Is this legit? Or are they eval maxing?