7 ms·
It lasted until Mistral released 3.1 Small a week later. Such is the pace of AI...
by grej 2y ago
It lasted until Mistral released 3.1 Small a week later. Such is the pace of AI...
- nirav72 2y agoyeah, I can't even keep up these days. So now mainly focus on what I can run locally via Ollama.
- simonw 2y agoGemma 3 is on Ollama now https://ollama.com/library/gemma3 https://ollama.com/library/gemma3 but surprisingly they don't have Mistral 3.1 yet. I've managed to run Mistral 3.1 on my laptop using MLX, notes here https://simonwillison.net/2025/Mar/17/mistral-small-31/ https://simonwillison.net/2025/Mar/17/mistral-small-31/
- thot_experiment 2y agoAre you running vision tasks? Works just fine in ollama as an LLM but the vision component is unimplemented.
- pitzips 2y agoI'm using gemma3:27b with the latest ollama (0.6.2) and vision is working.
- thot_experiment 2y agoYes but we're talking about mistral 3.1 here, which doesn't have the vision component implemented, looks like vllm supports it though.
- simonw 2y agoMistral 3.1 vision works with MLX and mlx-vlm - https://github.com/Blaizzy/mlx-vlm/pull/256 https://github.com/Blaizzy/mlx-vlm/pull/256 https://huggingface.co/mlx-community/Mistral-Small-3.1-24B-Instruct-2503-4bit https://huggingface.co/mlx-community/Mistral-Small-3.1-24B-I...
- lostmsu 2y agoHow's their lmarena ELO?