3 ms·
I think it's good at basic coding and is cheaper and faster. Trying it vs Fable 5.1 I don't see it being even close capability-wise. What I mean by basic codin
by rdtsc 16d ago
I think it's good at basic coding and is cheaper and faster. Trying it vs Fable 5.1 I don't see it being even close capability-wise. What I mean by basic coding is "write a script to parse this data" and answering some questions based on the code. It does that well and answers fast. However, when it comes to planning and thinking through a more complicated design problem it's just not there yet.
- Gareth321 16d agoIt's not even close. Some benchmarks show 3.8 Flash as being close to Astra (DeepSWE v1.1), but they are mostly "bench-maxed". Newer benchmarks like Terminal-Bench 4.0 show Astra at 57.9% and 3.8 Flash at 19.1%. For anyone who has tried to code with Gemini models, there is no contest here. Astra wins handily on every other benchmark, too. Research, science, 3D, visual, Humanity's Last Exam, etc.
- asdfman123 16d agoYou can't compare a heavyweight, expensive and slow model to Flash. Comparing apples to oranges.
- Gareth321 15d agoI agree, and I didn't compare them. The users above me did. I was explaining that they are, in fact, incomparable.