2 ms·

sidenote, but wow sonnet 5 is shockingly bad on this benchmark.

• notatoad 29d ago
  sonnet 5 is bad by almost any metric. anthropic really needs something to address the cheaper end of the market before they get left behind. Sonnet 5 sucks, and Haiku hasn't been updated in a year. meanwhile we've got gemini flash, luna, and GLM5.3 all delivering 90% of the performance for a small fraction of the cost. paying $25/mTok is going to start looking pretty silly soon.
  • surgical_fire 28d ago
    > flash, luna, and GLM5.3 all delivering 90% of the performance for a small fraction of the cost. I find GLM5.3 so much better than Sonnet it is not even funny. Sonnet behaves like a cheap model while being very expensive.