4 ms·
Matched roughly with Sol on DeepSwe cost per task. Luna way cheaper. DeepSeek used to be, but I think it's somewhere on Sol's curve after the price hike.
by andai 3mo ago
Matched roughly with Sol on DeepSwe cost per task.
Luna way cheaper. DeepSeek used to be, but I think it's somewhere on Sol's curve after the price hike.
- scotty79 3mo agoOn DeepSwe it's strictly beaten by Luna on max, cost and result. Damn, Luna on max is as good on DeepSWE as Kimi k3, I think I dismissed this model unjustly.
- HDBaseT 3mo agoThis is why benchmarks are scary, since Artificial Analysis puts it a fair bit behind Kimi K3. Kimi K3 is a beast though, just costly.
- dannyw 3mo agoStill cheaper than API rates for Opus!
- barrenko 3mo agoSo in a way Luna is the new Gemini Flash? I've been out of the game for a while.
- scotty79 3mo agoLuna is the smallest variant of gpt-5.6 from openai and it seems to beat Gemini Flash 3.7 on DeepSWE benchmark (which is one of the new coding benchmarks that people find more relevant to their daily work than old, saturated and gambled benchmarks). It beats it massively on cost and by a bit on quality.