4 ms·
I think these benchmarks are not that useful, e.g. this suggests Fable is better than Astra, but in practice Astra is waaaaaay faster (like 5x; it's not even cl
by IshKebab 1mo ago
I think these benchmarks are not that useful, e.g. this suggests Fable is better than Astra, but in practice Astra is waaaaaay faster (like 5x; it's not even close), and also waaaay less annoying to talk to.
There's only two or three sane options here - you can easily try them all and pick yourself.
- rovr138 1mo agoThey're not measuring speed nor annoyance. It's there on the page
- coderenegade 1mo agoI switched from Claude to Codex because Claude just doesn't do what you actually tell it to half the time. It dances around the edges and does busy work without actually tackling a tough problem. I'm not sure what others are doing that they're getting such different results, but I'll take Codex every day of the week.
- janaksunil 1mo agothat's fair - for long horizon engineering tasks would speed still matter?
- IshKebab 1mo agoI'd say so. Do you want your results in a week or a day?