3 ms·
Did you compare it to gemini-2.0-flash-lite?
by leobg 10mo ago
Did you compare it to gemini-2.0-flash-lite?
- leobg 10mo agoAnswering my own question: Artificial Analysis ranks them close in terms of price (both 0.3 USD/1M tokens) and intelligence (27 / 29 for gemini/mistral), but ranks gemini-2.0-flash-lite higher in terms of speed (189 tokens/s vs. 130). So they should be interchangeable. Looking forward to testing this. [0] https://artificialanalysis.ai/?models=o3%2Cgemini-2-5-pro%2Cgemini-2-5-flash-lite-preview-09-2025%2Cmistral-small-3-2%2Cdeepseek-r1%2Cgrok-3-mini-reasoning%2Cllama-3-1-nemotron-ultra-253b-v1-reasoning%2Cgpt-4o%2Cgpt-4-1%2Co4-mini%2Cgemini-2-0-flash-lite-preview%2Cgemini-2-0-flash%2Cgemini-2-5-flash-lite-reasoning%2Cgemini-2-0-flash-lite-001%2Cgemini-2-5-flash-reasoning%2Cgrok-3&cost=cost-vs-intelligence#intelligence-vs-price#intelligence-vs-cost-to-run-artificial-analysis-intelligence-index:~:text=Intelligence%20vs.%20Cost%20to%20Run%20Artificial%20Analysis%20Intelligence%20Index https://artificialanalysis.ai/?models=o3%2Cgemini-2-5-pro%2C...
- druskacik 10mo agoI did some vibe-evals only and it seemed slightly worse for my use case, so I didn't change it.