5 ms·
The two that I know of are SWE-bench and CodeElo. SWE-bench is oriented towards "real world" performance (resolution of GitHub issues), and CodeElo is oriented
by ta0608714652 2y ago
The two that I know of are SWE-bench and CodeElo. SWE-bench is oriented towards "real world" performance (resolution of GitHub issues), and CodeElo is oriented towards competitive programming (CodeForces).
https://www.swebench.com/ https://www.swebench.com/
https://codeelo-bench.github.io/ https://codeelo-bench.github.io/