3 ms·
Yes but we're talking about mistral 3.1 here, which doesn't have the vision component implemented, looks like vllm supports it though.
by thot_experiment 2y ago
Yes but we're talking about mistral 3.1 here, which doesn't have the vision component implemented, looks like vllm supports it though.
- simonw 2y agoMistral 3.1 vision works with MLX and mlx-vlm - https://github.com/Blaizzy/mlx-vlm/pull/256 https://github.com/Blaizzy/mlx-vlm/pull/256 https://huggingface.co/mlx-community/Mistral-Small-3.1-24B-Instruct-2503-4bit https://huggingface.co/mlx-community/Mistral-Small-3.1-24B-I...