3 ms·
EDIT: I updated the article to account for this perspective. ------ This can't be right -- they're using LMArena without style control to resolve the market,
by theahura 1y ago
EDIT: I updated the article to account for this perspective.
------
This can't be right -- they're using LMArena without style control to resolve the market, and GPT-5 is ahead right? (https://lmarena.ai/leaderboard/text/overall-no-style-control https://lmarena.ai/leaderboard/text/overall-no-style-control)
> This market will resolve according to the company which owns the model which has the highest arena score based off the Chatbot Arena LLM Leaderboard (https://lmarena.ai/ https://lmarena.ai/) when the table under the "Leaderboard" tab is checked on August 31, 2025, 12:00 PM ET.
> Results from the "Arena Score" section on the Leaderboard tab of https://lmarena.ai/leaderboard/text https://lmarena.ai/leaderboard/text with the style control off will be used to resolve this market.
> If two models are tied for the top arena score at this market's check time, resolution will be based on whichever company's name, as it is described in this market group, comes first in alphabetical order (e.g. if both were tied, "Google" would resolve to "Yes", and "xAI" would resolve to "No")
> The resolution source for this market is the Chatbot Arena LLM Leaderboard found at https://lmarena.ai/ https://lmarena.ai/. If this resolution source is unavailable at check time, this market will remain open until the leaderboard comes back online and resolve based on the first check after it becomes available. If it becomes permanently unavailable, this market will resolve based on another resolution source.
- surround 1y agoYou may have already figured this out, but the leaderboard you linked to (https://lmarena.ai/leaderboard/text/overall-no-style-control https://lmarena.ai/leaderboard/text/overall-no-style-control) shows gemini-2.5-pro ahead with a score of 1471 compared to gpt-5 at 1462.
- tim333 1y agogpt-5 was ahead on that last night
- surround 1y agoThe leaderboard hasn't changed since it was updated to add gpt-5. Here's what it looked like yesterday https://archive.is/XIrbN https://archive.is/XIrbN If you saw gpt-5 was ahead, you might have been looking at the leaderboard with style control https://lmarena.ai/leaderboard/text/overall https://lmarena.ai/leaderboard/text/overall
- rrhjm53270 1y agoIt is very interesting that among top-20 models, all non-proprietary ones are from China.