3 ms·
SWE-bench scores are inflated compared against actual maintainer merge decisions as opposed to an LLM grader.
by croemer 7mo ago
SWE-bench scores are inflated compared against actual maintainer merge decisions as opposed to an LLM grader.
3 ms·