Yeah, I know. I didn't say it was incredibly better in every bench, but there are reasoning and planning benchmarks it does much better (not just slightly) than

Yeah, I know. I didn't say it was incredibly better in every bench, but there are reasoning and planning benchmarks it does much better (not just slightly) than Sonnet 3.5 and the rest right now, and that still that makes their offering SOTA vs the others, even if its not in terms of cost. I put sources in another sibling comment, and as I said in both comments, I think that gap will close. I don't expect OAI to keep their moat much longer, especially with the people they've lost. PS: I say all of this as a constant critic of OAI: both how they behave and their offerings. But credit where credit is due, I don't see out-of-the-box alternatives to OAI's rlhf'd CoT at any price point right now.