6 ms·
Did each developer do a large enough mix of AI/non-AI tasks, in varying orders, that you have any hints in your data whether the "AI penalty" grew or shrunk ove
by gojomo 1y ago
Did each developer do a large enough mix of AI/non-AI tasks, in varying orders, that you have any hints in your data whether the "AI penalty" grew or shrunk over time?
- narush 1y agoYou can see this analysis in the factor analysis of "Below-average use of AI tools" (C.2.7) in the paper [1], which we mark as an unclear effect. TLDR: over the first 8 issues, developers do not appear to get majorly less slowed down. [1] https://metr.org/Early_2025_AI_Experienced_OS_Devs_Study.pdf https://metr.org/Early_2025_AI_Experienced_OS_Devs_Study.pdf