2 ms·
Yes and no. "Last-gen" (like, from 6 months ago) frontier models do still tend to outperform the best open source models. But some models, especially GLM-5, rea
by lend000 7mo ago
Yes and no. "Last-gen" (like, from 6 months ago) frontier models do still tend to outperform the best open source models. But some models, especially GLM-5, really have captured whatever circuitry drives pattern matching in the models they were trained off of.
I like this benchmark that competes models against one another in competitive environments, which seems like it can't really be gamed: https://gertlabs.com https://gertlabs.com
- Aurornis 7mo ago> Yes and no. "Last-gen" (like, from 6 months ago) frontier models do still tend to outperform the best open source models That’s exactly what I said, though. The headline we’re commenting under claims they’re Sonnet 4.5 level but they’re not. I don’t disagree that they’re powerful for open models. I’m pointing out that anyone reading these headlines who expects a cheap or local Sonnet 4.5 is going to discover that it’s not true.