Of these, I think I'm most surprised by Vicuna-33B. For having MIT Bench and MMLU scores significantly worse than #4 and #5, it fairs quite well (47% and 42% c

Of these, I think I'm most surprised by Vicuna-33B. For having MIT Bench and MMLU scores significantly worse than #4 and #5, it fairs quite well (47% and 42% choice rate 1v1). Its only vs the #3+ things get bad (although notably also does better vs GPT-4 than many) Really, the choice rate's not bad when you really look at it. Even vs the top its 1/3, 2/3. Nowhere near as bad as NBA/NFL vs high-schoolers or similar "Professional Grade" situation. Also the first Non-Commercial top option.