4 ms·
MistralAI is known for their smaller models on the edge, to avoid competing with Gemini & OpenAI directly.
by goldenarm 8mo ago
MistralAI is known for their smaller models on the edge, to avoid competing with Gemini & OpenAI directly.
- mycall 8mo agoWho knows if OpenAI will do a refresh, but gpt-oss-20B/120B are still some of the best edge models so far.
- carterschonwald 8mo agooh?! what do they handle well? how do they fail? the 3.5 9b model on my laptop at full fp8 is outlandish in its seeming reasoning capacity, though i haven’t really stress tested it