3 ms·
The Polyglot aider improvement over o3 is imperceptible, not great.
by croemer 1y ago
The Polyglot aider improvement over o3 is imperceptible, not great.
- qsort 1y agoSWE-Bench is also not stellar. "It's important to remember" that: - they are only evals - this is mostly positioned as a general consumer product, they might have better stuff for us nerds in hand.