4 ms·
I wonder if anyone has actually measured the difference in verification time between these models. A senior dev in a high cost of living area costs the company
by devinodowd 3mo ago
I wonder if anyone has actually measured the difference in verification time between these models. A senior dev in a high cost of living area costs the company something like $200 an hour. If a cheaper model produces code that takes an extra 20 minutes to debug or verify because it missed a subtle edge case, you have already lost any savings from the lower API bill. It feels like the real moat for labs like Anthropic is the level of trust a reviewer can have in the output without reading every single line. Curious how much people trust GLM over something like Opus? Is there much of a marginal difference here?
- tokoi 3mo ago[flagged]
- senordevnyc 3mo agoThis is exactly how I see it, and why I’m often willing to pay Fable rates. Yes, I might spend $300 on a feature instead of $20, but it’ll be done in a tenth of my time, thanks to faster iteration in both the planning and post-impl verification / iteration stage. Plus a mistake could easily cause a bug that costs me a customer worth four or five figures of LTV, and the feature might easily add tens of thousands in marginal revenue over the coming years. So really $300 is nothing, it’s barely worth worrying about.