2 ms·
Quite interesting that Mistral scores so abysmally on this metric while outperforming Llama 2 7B and 13B easily in all other benchmarks. I suppose they must hav
by moffkalast 3y ago
Quite interesting that Mistral scores so abysmally on this metric while outperforming Llama 2 7B and 13B easily in all other benchmarks. I suppose they must have on average ~5% less things memorized?
- Rastonbury 3y agoI think it is from RLHF. If you ask Mistral for something that doesn't exist it will create fantastical but plausible sounding explanations