3 ms·
>Astra, on average, despite its GPT 6 version bump, is not any better at coding than Sol. This is a ridiculous claim that is disproven by simply using it for m
by heaney-555 1mo ago
>Astra, on average, despite its GPT 6 version bump, is not any better at coding than Sol.
This is a ridiculous claim that is disproven by simply using it for more than 5 minutes.
https://withspecific.com/benchmarks/real-swe https://withspecific.com/benchmarks/real-swe
- deleted 1mo ago[deleted]
- rico735 29d agoThere is a theory that they are training them on those benchmark tests. No way to know if that's true, but there is also no reason to trust these companies to not do something like that. They lie a lot. The "how much time does it save a dev" tests seem a stronger way to measure success, but not seen one of those run for a while. Not bothered with Astra myself, but the demos I've seen people build don't seem any more impressive on the important stuff. Defaulting to three.js for games just feels smoke-and-mirrors to make them look better, as those games are still as unplayable for the same reasons they were in 2D.