4 ms·
On DeepSwe it's strictly beaten by Luna on max, cost and result. Damn, Luna on max is as good on DeepSWE as Kimi k3, I think I dismissed this model unjustly.
by scotty79 2mo ago
On DeepSwe it's strictly beaten by Luna on max, cost and result.
Damn, Luna on max is as good on DeepSWE as Kimi k3, I think I dismissed this model unjustly.
- HDBaseT 2mo agoThis is why benchmarks are scary, since Artificial Analysis puts it a fair bit behind Kimi K3. Kimi K3 is a beast though, just costly.
- dannyw 2mo agoStill cheaper than API rates for Opus!
- barrenko 2mo agoSo in a way Luna is the new Gemini Flash? I've been out of the game for a while.
- scotty79 2mo agoLuna is the smallest variant of gpt-5.6 from openai and it seems to beat Gemini Flash 3.7 on DeepSWE benchmark (which is one of the new coding benchmarks that people find more relevant to their daily work than old, saturated and gambled benchmarks). It beats it massively on cost and by a bit on quality.