4 ms·

https://x.com/giansegato/status/2002203155262812529/photo/1 https://x.com/giansegato/status/2002203155262812529/photo/1 https://x.com/METR_Evals/status/2002203

• MrOrelliOReilly 10mo ago
  Yes, I personally feel that the "official" benchmarks are increasingly diverging from the everyday reality of using these models. My theory is that we are reaching a point where all the models are intelligent enough for day-to-day queries, so points like style/personality and proper use of web queries and other capabilities are better differentiators than intelligence alone.
  • int_19h 10mo ago
    The benchmarks haven't reflected the real utility for a very long time. At best they tell you which models are definitely bad.