This is the "agent with a hammer" problem. The agent is optimized to make changes, so it changes things even when it shouldn't. What's missing is a feedback loo

This is the "agent with a hammer" problem. The agent is optimized to make changes, so it changes things even when it shouldn't. What's missing is a feedback loop that says "your change made things worse."