4 ms·
it's worse on nearly every benchmark
by asdev 1y ago
it's worse on nearly every benchmark
- brokensegue 1y agono? it's better on AIME '24, Multilingual MMLU, SWE-bench, Aider’s polyglot, MMMU, ComplexFuncBench and it ties on a lot of benchmarks
- asdev 1y agolook at all the graphs in the article
- brokensegue 1y agothe data i posted all came from the graphs/charts in the article
- porphyra 1y agoOpenAI themselves said > One last note: we’ll also begin deprecating GPT-4.5 Preview in the API today as GPT-4.1 offers improved or similar performance on many key capabilities at lower latency and cost. GPT-4.5 in the API will be turned off in three months, on July 14, to allow time to transition (and GPT 4.5 will continue to be available in ChatGPT). https://x.com/OpenAIDevs/status/1911860805810716929 https://x.com/OpenAIDevs/status/1911860805810716929