2 ms·
There should be a way to turn the questions we ask LLMs into benchmarks. That way, we can have a benchmark that is always up to date.
by amelius 8mo ago
There should be a way to turn the questions we ask LLMs into benchmarks.
That way, we can have a benchmark that is always up to date.
- lurkshark 8mo agoThere are a few “updating” benchmarks out there. I periodically take a look at these two: https://swe-rebench.com/ https://swe-rebench.com/ https://livebench.ai/ https://livebench.ai/