4 ms·

From the post: "Evaluation began immediately after the 2025 IMO problems were released to prevent contamination." Doe this address your concern?

• os2warpman 1y ago
  What they mean is that in a couple of weeks there are going to be stories titled "LLMS NOW BETTER THAN HUMANS AT 2025 INTERNATIONAL MATH OLYMPIAD" (stories published as thinly-veiled investment solicitations) but in reality they're still shitty-- they've just had the answers fed in to be spit back out.
  • sorokod 1y ago
    Companies would game metrics whenever they have the opportunity. What else is new?
    • esafak 1y ago
      I suppose what's new is that the models aren't as smart as their companies claimed.
• chvid 1y ago
  Not really.