3 ms·
Blow everything out of the water on llmarena https://arena.ai/leaderboard/text-to-image https://arena.ai/leaderboard/text-to-image
by gpt5 6mo ago
Blow everything out of the water on llmarena
https://arena.ai/leaderboard/text-to-image https://arena.ai/leaderboard/text-to-image
- be7a 6mo ago242 Elo points clear of the next best model and 93% win rate against random models (96% against nano banana) while Gemini 3.1 (second best) sits at 67%. That’s quite the leap.
- brcmthrowaway 6mo agoHow is text to image even scored? Seems like a subjective measurement..
- be7a 6mo agoUsers get two completions for their prompt and rank them. From this you can then use Bradley-Terry to get Elo scores per model.
- vunderba 6mo agoLM Arena is a particularly bad comparison site too. Prompts that they use are usually incredibly generic like "A digital render of a sleek, futuristic motorcycle racing through a neon-lit cityscape." I actually built GenAI Showdown a while back because I was deeply unsatisfied with LM Arena and other purported comparison tables which either (A) relied solely on visual fidelity (which is a far less interesting benchmark than adherence, IMHO) and/or (B) relied on extremely simplistic and banal prompts.