2 ms·
> * METR was at best a flawed study. They didn't claim it was flawless, they had just brought it up because it caused them to question their internal narrative
by ModernMech 1y ago
> * METR was at best a flawed study.
They didn't claim it was flawless, they had just brought it up because it caused them to question their internal narrative of their own productivity.
> * Their own self-experiment is not exactly statistically sound :)
They didn't claim it was.
> * they assume that all code gets shipped as a product.
The author did not assume this. They assumed that if AI is making developers more productive, that should apply to shovelware developers. That we don't see an increase in shovelware post-AI, makes it very unlikely AI brings an increase in productivity for more complex software.