4 ms·
> SWE-bench performance is similar to normal gpt-5, so it seems the main delta with `gpt-5-codex` is on code refactors SWE-bench is a great eval, but it's very
by tedsanders 1y ago
> SWE-bench performance is similar to normal gpt-5, so it seems the main delta with `gpt-5-codex` is on code refactors
SWE-bench is a great eval, but it's very narrow. Two models can have the same SWE-bench scores but very different user experiences.
Here's a nice thread on X about the things that SWE-bench doesn't measure:
https://x.com/brhydon/status/1953648884309536958 https://x.com/brhydon/status/1953648884309536958
- dwaltrip 1y agoso annoying you cant read replies without an account nowadays