4 ms·
I got the impression that 03-mini or 03-mini-high were meant for coding? GPT 4.1 was meant for creative writing, not coding?
by iJohnDoe 1y ago
I got the impression that 03-mini or 03-mini-high were meant for coding? GPT 4.1 was meant for creative writing, not coding?
- conradev 1y agoIt’s good at a lot of things: GPT‑4.1 scores 54.6% on SWE-bench Verified, improving by 21.4%abs over GPT‑4o and 26.6%abs over GPT‑4.5—making it a leading model for coding. https://openai.com/index/gpt-4-1/ https://openai.com/index/gpt-4-1/
- coliveira 1y agoThey are trained on these "benchmarks", that's why they score better.
- elzbardico 1y agoIf they were trained on those benchmarks they would score 100%
- coliveira 1y agoThey show how bad they are, they cannot score 100% on benchmarks they were trained on.