Getting the agent to run tests definitely can have a very positive impact - it can actually realize itself that it broke something unrelated, and fix it (or eas

Getting the agent to run tests definitely can have a very positive impact - it can actually realize itself that it broke something unrelated, and fix it (or easily be prompted if it gives up anyway). Aside: I often remove some of the tests that seem superfluous to me, or explicitly ask for the minimal set of tests that still cover the functionality in the first place. Some models definitely can go "all in" on tests like a very eager intern that just learned about testing. For your cases where after a prompt you end up with broken functionality, just having an integration test that fails when the functionality breaks, might be enough.