3 ms·

For what it's worth - over the last few years or whatever, it seems like Anthropic benchmaxxes the least. That being said, I currently prefer Sol / Astra to O

• vessenes 13d ago
  I was going to say the reverse - claude has been the less satisfying normalized by benchmark for me in the last year. Both astra and fable have their quirks, but I am 90% codex this year up from 10% last year.
• vintermann 13d ago
  It's not just about benchmaxxing. Sincerely targeting those long-autonomy benchmarks is questionable in the first place, because naturally it drives the model to assume more and more about what you want.
  • svachalek 13d ago
    The target market for frontier models is CEOs who want to lay off entire departments of their company. So the long autonomy benchmarks would seem to be sending exactly the right signal.
    • vintermann 12d ago
      They're still going to have to communicate with the bots replacing those departments they lay off, or they're going to have a bad time.