3 ms·
This new release is a finetune of Mistral-7B base model. They claim it achieves 98% of the eval performance of Llama2-70B.
by easygenes 3y ago
This new release is a finetune of Mistral-7B base model. They claim it achieves 98% of the eval performance of Llama2-70B.
- easygenes 3y agoHaving tested this model a lot today, I can say that it indeed in a lot of ways feels much like a 70B model, much to my surprise. One thing that really struck me: I asked it details about my local suburbs (minor cities in a larger metro). I have tried this on all different Llamas, and only the 70B models don't just hallucinate everything or tell me they don't know anything. In contrast, this model knows quite a bit about my local area. Not as good as Llama2-70B, but not incredibly far off.