I made GGUFs + it has tool calling support - I had to verify it via mistral_common! Also vision support should work as well! https://huggingface.co/unsloth/Devs

I made GGUFs + it has tool calling support - I had to verify it via mistral_common! Also vision support should work as well! https://huggingface.co/unsloth/Devstral-Small-2507-GGUF https://huggingface.co/unsloth/Devstral-Small-2507-GGUF Also guide on running Devstral: https://docs.unsloth.ai/basics/tutorials-how-to-fine-tune-and-run-llms/devstral-how-to-run-and-fine-tune https://docs.unsloth.ai/basics/tutorials-how-to-fine-tune-an... ./llama.cpp/llama-cli -hf unsloth/Devstral-Small-2507-GGUF:Q4_K_XL --jinja --temp 0.15 -ngl 99