3 ms·
Upgrading agentic coding capabilities with the new Devstral models
- danielhanchen 1y agoI made GGUFs + it has tool calling support - I had to verify it via mistral_common! Also vision support should work as well! https://huggingface.co/unsloth/Devstral-Small-2507-GGUF https://huggingface.co/unsloth/Devstral-Small-2507-GGUF Also guide on running Devstral: https://docs.unsloth.ai/basics/tutorials-how-to-fine-tune-and-run-llms/devstral-how-to-run-and-fine-tune https://docs.unsloth.ai/basics/tutorials-how-to-fine-tune-an... ./llama.cpp/llama-cli -hf unsloth/Devstral-Small-2507-GGUF:Q4_K_XL --jinja --temp 0.15 -ngl 99
- osxman 1y agoThis is a great new AI 'Mistral Medium' model from Mistral, I used it in Zed editor today via Mistral API – and will keep on using this. It brings great code suggestions, improvements and explanations. Worth to give it a go. Note: should be configured manually in Zed at time of this writing but then works like charm. (Use devstral-medium-2507 or devstral-medium-latest)