3 ms·

This is my experience as well. Mistral models may not be the best according to benchmarks and I don't use them for personal chats or coding, but for simple task

This is my experience as well. Mistral models may not be the best according to benchmarks and I don't use them for personal chats or coding, but for simple tasks with pre-defined scope (such as categorization, summarization, etc.) they are the option I choose. I use mistral-small with batch API and it's probably the best cost-efficient option out there.

leobg 10mo ago
Did you compare it to gemini-2.0-flash-lite?
- leobg 10mo ago
  Answering my own question: Artificial Analysis ranks them close in terms of price (both 0.3 USD/1M tokens) and intelligence (27 / 29 for gemini/mistral), but ranks gemini-2.0-flash-lite higher in terms of speed (189 tokens/s vs. 130). So they should be interchangeable. Looking forward to testing this. [0] https://artificialanalysis.ai/?models=o3%2Cgemini-2-5-pro%2Cgemini-2-5-flash-lite-preview-09-2025%2Cmistral-small-3-2%2Cdeepseek-r1%2Cgrok-3-mini-reasoning%2Cllama-3-1-nemotron-ultra-253b-v1-reasoning%2Cgpt-4o%2Cgpt-4-1%2Co4-mini%2Cgemini-2-0-flash-lite-preview%2Cgemini-2-0-flash%2Cgemini-2-5-flash-lite-reasoning%2Cgemini-2-0-flash-lite-001%2Cgemini-2-5-flash-reasoning%2Cgrok-3&cost=cost-vs-intelligence#intelligence-vs-price#intelligence-vs-cost-to-run-artificial-analysis-intelligence-index:~:text=Intelligence%20vs.%20Cost%20to%20Run%20Artificial%20Analysis%20Intelligence%20Index https://artificialanalysis.ai/?models=o3%2Cgemini-2-5-pro%2C...
- druskacik 10mo ago
  I did some vibe-evals only and it seemed slightly worse for my use case, so I didn't change it.