2 ms·
It appears that they’re using the PRs from the top5000 most popular PyPi packages for their bench: https://github.com/princeton-nlp/SWE-bench/tree/main/swebench
by stingraycharles 3y ago
It appears that they’re using the PRs from the top5000 most popular PyPi packages for their bench: https://github.com/princeton-nlp/SWE-bench/tree/main/swebench/collect https://github.com/princeton-nlp/SWE-bench/tree/main/swebenc...