"In a memo to employees in April, the chief executive of Shopify, a company that helps entrepreneurs build and manage e-commerce websites, announced that “A.I.

"In a memo to employees in April, the chief executive of Shopify, a company that helps entrepreneurs build and manage e-commerce websites, announced that “A.I. usage is now a baseline expectation” and that the company would “add A.I. usage questions” to performance reviews." Usage of a tool becoming a performance metric is a clear sign that the tool isn't doing what it's promised to do. This is managers desperately trying to prevent their investment in GenAI from blowing up in their faces. This is as clear an admission as any that the supposed productivity or quality gains from LLM coding aren't showing up in the results. If a tool is effective, management generally doesn't have to micromanage and force employees into using it.