3 ms·

It's worth noting that OpenAI recently came out saying, "We don't think SWEBench Pro is worth reporting any more" - https://openai.com/index/separating-signal-f

• 37374848 3mo ago
  [flagged]
  • William_BB 3mo ago
    People will downvote you because this comment is "not appropriate" for HN, but there were countless conversations on HN about how important these benchmarks are. I am literally LOLing at HN right now
    • Sabinus 3mo ago
      You're free to lol but at least put a substantive comment with it. 'Lol' by itself is low quality.
    • anthonyrstevens 3mo ago
      It's almost like there are multiple different people commenting on HN.