3 ms·

I've stopped trusting these "trust me bro" benchmarks and just started going to LM Arena and looking for the actual benchmark comparisons. https://arena.ai/lea

by numbers 5mo ago

I've stopped trusting these "trust me bro" benchmarks and just started going to LM Arena and looking for the actual benchmark comparisons. https://arena.ai/leaderboard/code https://arena.ai/leaderboard/code

nba456_ 5mo ago
This is not any better of a benchmark
stri8ted 5mo ago
I doubt this is representative of real world usage. There is a difference between a few turns on a web chatbot, vs many-turn cli usage on a real project.