> and Mistral Medium is second only to GPT-4 on the Chatbot Arena ..Chatbot Arena is an incredibly flawed metric. Incredibly biased towards English, and toward

> and Mistral Medium is second only to GPT-4 on the Chatbot Arena ..Chatbot Arena is an incredibly flawed metric. Incredibly biased towards English, and towards certain kinds of tasks people are more likely to test on Chatbot Arena. If you use a broad range of tasks, let alone in a diverse range of languages, unfortunately GPT-4 is still miles ahead of Mistral. I wish it wasn't the case, hope Mistral catches up as soon as possible.