3 ms·

And DeepSeek is just 3% behind. It seems in that benchmark all LLMs perform well and top is formed within some statistical error.

• rvnx 2y ago
  It could also be that they got "inspired" by DeepSeek, hence the very similar results. So it could be that their success is mostly about taking an open and free thing, and turned it proprietary.
• torginus 2y ago
  These percentage points don't mean anything. Look up how the Elo system works. They just add 1000 to the result to make it a nicer number.
  • riku_iki 2y ago
    There are llms below 1000 in the leaderboard
    • torginus 2y ago
      So? Percentage points are only meaningful when the mean of the dataset is 0, which is not the case here.