There are a few “updating” benchmarks out there. I periodically take a look at these two: https://swe-rebench.com/ https://swe-rebench.com/ https://livebench.

There are a few “updating” benchmarks out there. I periodically take a look at these two: https://swe-rebench.com/ https://swe-rebench.com/ https://livebench.ai/ https://livebench.ai/