4 ms·
Mistral derivatives have barely any guardrails.
by atemerev 3y ago
Mistral derivatives have barely any guardrails.
- Semaphor 3y agoBut Mistral 7B has horrible writing. This, for my tests, wrote actual sentences that made sense. Which IME for 7B is extremely impressive. Writing is still far worse than GPT 3.5, but well, 7B.
- atemerev 3y agoFor my tests, Mistral-based models writing was excellent, particularly with zephyr-7b-beta and starling-7b-alpha derivatives (original Mistral is somewhat too dry). Far better than everything before in OSS (including 70B models), and certainly on par with GPT-3.5.
- Semaphor 3y agoHuh, that’s a huge difference. I actually tested Mistral, and it was just bad. I agree that Zephyr is very similar to gpt3.5