3 ms·
Are they a lot better than 3.5? I see wildly varying opinions.
by stavros 3y ago
Are they a lot better than 3.5? I see wildly varying opinions.
- MacsHeadroom 3y agoMistral-Medium, the one announced here which beats GPT-3.5 on every benchmark, isn't even available yet. Those opinions are referencing Mistral-Tiny (aka Mistral-7B). However, Mistral-Tiny beats the latest GPT-3.5 in human ratings on the chatbot-arena-leaderboard, in the form of OpenHermes-2.5-Mistral-7B. Mixtral 8x7B aka (Mistral-Small) was released a couple of days ago and will likely come close to GPT-4, and well above GPT-3.5, on the leaderboards once it has gone through some finetuning.
- whimsicalism 3y agoThey could be. It is an open question whether the driving force will be OSS improving or OAI continuing to try to distill their model.