4 ms·
I can't figure out if this is available in the official Mistral API or not. Their model listing API returns this: { "id": "mistral-medium-2508", "ob
by simonw 6mo ago
I can't figure out if this is available in the official Mistral API or not.
Their model listing API returns this:
{
"id": "mistral-medium-2508",
"object": "model",
"created": 1777479384,
"owned_by": "mistralai",
"capabilities": {
"completion_chat": true,
"function_calling": true,
"reasoning": false,
"completion_fim": false,
"fine_tuning": true,
"vision": true,
"ocr": false,
"classification": false,
"moderation": false,
"audio": false,
"audio_transcription": false,
"audio_transcription_realtime": false,
"audio_speech": false
},
"name": "mistral-medium-2508",
"description": "Update on Mistral Medium 3 with improved capabilities.",
"max_context_length": 131072,
"aliases": [
"mistral-medium-latest",
"mistral-medium",
"mistral-vibe-cli-with-tools"
],
"deprecation": null,
"deprecation_replacement_model": null,
"default_model_temperature": 0.3,
"type": "base"
},
So that has the alias "mistral-medium-latest", but the official ID is "mistral-medium-2508" which suggests it's the model they released in August 2025.
But... that 1777479384 timestamp decodes to Wednesday, April 29, 2026 at 04:16:24 PM UTC
So is that the new Mistral Medium?
- simonw 6mo agoSome poking around in the source code for https://github.com/mistralai/mistral-vibe https://github.com/mistralai/mistral-vibe got me to this: curl https://api.mistral.ai/v1/chat/completions \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $(llm keys get mistral)" \ -d '{ "model": "mistral-medium-3.5", "messages": [ {"role": "user", "content": "Generate an SVG of a pelican riding a bicycle"} ] }' Which did work: https://gist.github.com/simonw/f3158919b18d2c47863b0a5dc257a355#response https://gist.github.com/simonw/f3158919b18d2c47863b0a5dc257a... - it's pretty disappointing. Weird that it doesn't show up in the model list: curl https://api.mistral.ai/v1/models \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $(llm keys get mistral)" | jq
- Mashimo 6mo agoI also did some SVG tests, it's really bad. https://chat.mistral.ai/chat/897fbe7d-b1ae-4109-9b29-f3ccc4f8896d https://chat.mistral.ai/chat/897fbe7d-b1ae-4109-9b29-f3ccc4f...
- spijdar 6mo agoWow. I get that "how well can it make SVGs" isn't the (or a) gold standard for how useful a model is or isn't, but the fact the Gemma 4 26B A4B I'm running locally can blow it out of the water doesn't give me high confidence for the model. Maybe an unfair comparison, but...
- cyanydeez 6mo agoI'm curios: are you doing a real apples to apples comparison, or are you running a harness that already curates prompts? There's a far and wide margin how any of these models respond based on already loaded context. Most models are pretty much hot garbage until their context is curated appropiately.
- spijdar 6mo agoI just copied and pasted each prompt as specified by Mashimo and simonw into a chat interface, using a 4-bit Unsloth quantization of Gemma 4 26B, with the default sampler settings recommended by Google, and a system prompt of "You are a helpful assistant". The results are miles ahead of what the Mistral model output. I've gotten a lot of use out of Mistral models, and I imagine this model is pretty good at other things, but it really feels like a 128B parameter dense model should be at least a little better than this.
- Mashimo 6mo agoIt's so bad I don't want to spend the 18 EUR just to test it for a month. It can't even create an SVG of the facebook logo. There should be plenty of examples of that around. Gemini fast could do that in under 5 seconds.
- 2ndorderthought 6mo agoIt sounds like they focussed performance on not drawing svgs. Which honestly, makes a lot of sense to me.
- spijdar 6mo ago