2 ms·
Not at the moment, but a release of Mistral 4 seems close which likely bridges the gap.
by DarkNova6 7mo ago
Not at the moment, but a release of Mistral 4 seems close which likely bridges the gap.
- re-thc 7mo agoMistral Small 4 is already announced.
- androiddrew 7mo agoMOE but 120B range. Man I wish it was an 80B. I have 2 GPUs with 62Gib of usable VRAM. A 4bit 80B gives me some context window, but 120B puts me into system RAM
- Aerroon 7mo agoEither some q3 or since it's a MoE, maybe a REAP version of q4 might work (or could be terrible, I'm not sure about REAP'd models).