On the topic of "The better you make the automation, the more difficult it is to guard against these catastrophic failures in the future, because the automation

On the topic of "The better you make the automation, the more difficult it is to guard against these catastrophic failures in the future, because the automation becomes more and more powerful, and you rely on it more and more." it's instructive to read the last story of Asimov's "I, Robot" called the "Evitable Conflict" in which the machines lead the Earth's progress.