3 ms·

Definitely congrats to them. I don't hate on Mistral though; their open-source models are extremely capable for their size and parameter count, and Mistral Medi

Definitely congrats to them. I don't hate on Mistral though; their open-source models are extremely capable for their size and parameter count, and Mistral Medium is second only to GPT-4 on the Chatbot Arena (I'm not including Bard, since Bard gives their chatbot access to the internet, whereas the other models are being interacted with solely on the basis of their innate knowledge; that doesn't seem apples-to-apples, and the underlying Gemini Pro model without access to the internet underperforms GPT-4 and Mistral). And Mistral Medium is much cheaper than GPT-4 — around $8/million tokens, whereas GPT-4-Turbo is $30/million tokens. So I'd say Mistral is doing a decent job. With this kind of regulatory regime I wonder how much of the next wave of AI companies are going to be started abroad... I sort of doubt Mistral is the last one, even though the U.S. has such high talent density.

maeil 3y ago
> and Mistral Medium is second only to GPT-4 on the Chatbot Arena ..Chatbot Arena is an incredibly flawed metric. Incredibly biased towards English, and towards certain kinds of tasks people are more likely to test on Chatbot Arena. If you use a broad range of tasks, let alone in a diverse range of languages, unfortunately GPT-4 is still miles ahead of Mistral. I wish it wasn't the case, hope Mistral catches up as soon as possible.
- maeil 3y ago
  Would've been great if anyone disagreeing could've highlighted why, but alas. If you've tried Mistral on some creative tasks in a wide range of languages and found it competitive with GPT-4, please do tell.
rvnx 3y ago
I agree with you it's great that Mistral exists and the efforts they do are very useful. I'm sure they are going to improve, but compared to what you have shown it's still more of a garage-shop. (Is Mistral worth 2B+ EUR ? That's another question). In one way or another, such regulation already implicitly exist in all the countries where there is no First Amendment equivalent. Perhaps a workaround would be to claim that this is free speech protected by the Fist Amendment and shouldn't be controlled. (Back to Mistral and regulations), in France, for example, there are certain words or things you cannot write or say without risking to go to jail (in theory, but in practice it's mostly fines), or if you spread certain historical "fake news".

maeil 3y ago

> and Mistral Medium is second only to GPT-4 on the Chatbot Arena ..Chatbot Arena is an incredibly flawed metric. Incredibly biased towards English, and towards certain kinds of tasks people are more likely to test on Chatbot Arena. If you use a broad range of tasks, let alone in a diverse range of languages, unfortunately GPT-4 is still miles ahead of Mistral. I wish it wasn't the case, hope Mistral catches up as soon as possible.

maeil 3y ago
Would've been great if anyone disagreeing could've highlighted why, but alas. If you've tried Mistral on some creative tasks in a wide range of languages and found it competitive with GPT-4, please do tell.

rvnx 3y ago

I agree with you it's great that Mistral exists and the efforts they do are very useful. I'm sure they are going to improve, but compared to what you have shown it's still more of a garage-shop. (Is Mistral worth 2B+ EUR ? That's another question). In one way or another, such regulation already implicitly exist in all the countries where there is no First Amendment equivalent. Perhaps a workaround would be to claim that this is free speech protected by the Fist Amendment and shouldn't be controlled. (Back to Mistral and regulations), in France, for example, there are certain words or things you cannot write or say without risking to go to jail (in theory, but in practice it's mostly fines), or if you spread certain historical "fake news".