4 ms·
It’s good at a lot of things: GPT‑4.1 scores 54.6% on SWE-bench Verified, improving by 21.4%abs over GPT‑4o and 26.6%abs over GPT‑4.5—making it a leading mod
by conradev 1y ago
It’s good at a lot of things:
GPT‑4.1 scores 54.6% on SWE-bench Verified, improving by 21.4%abs over GPT‑4o and 26.6%abs over GPT‑4.5—making it a leading model for coding.
https://openai.com/index/gpt-4-1/ https://openai.com/index/gpt-4-1/
- coliveira 1y agoThey are trained on these "benchmarks", that's why they score better.
- elzbardico 1y agoIf they were trained on those benchmarks they would score 100%
- coliveira 1y agoThey show how bad they are, they cannot score 100% on benchmarks they were trained on.