3 ms·
It's not even close. Some benchmarks show 3.8 Flash as being close to Astra (DeepSWE v1.1), but they are mostly "bench-maxed". Newer benchmarks like Terminal-Be
by Gareth321 10d ago
It's not even close. Some benchmarks show 3.8 Flash as being close to Astra (DeepSWE v1.1), but they are mostly "bench-maxed". Newer benchmarks like Terminal-Bench 4.0 show Astra at 57.9% and 3.8 Flash at 19.1%. For anyone who has tried to code with Gemini models, there is no contest here.
Astra wins handily on every other benchmark, too. Research, science, 3D, visual, Humanity's Last Exam, etc.
- asdfman123 10d agoYou can't compare a heavyweight, expensive and slow model to Flash. Comparing apples to oranges.
- Gareth321 9d agoI agree, and I didn't compare them. The users above me did. I was explaining that they are, in fact, incomparable.