> Isn't that the points of automation, though? [...] even to do the tasks faster than humanly possible Yes, but not beyond the point where you get rid of the f

> Isn't that the points of automation, though? [...] even to do the tasks faster than humanly possible Yes, but not beyond the point where you get rid of the failsafes. People in the engineering industry understand that. They design skyscrapers within safety ranges and test their resistance on prototype models; and build planes and spaceships that can be operated without relying on the automated enhancements, and put procedures in place to check every combination that could possibly go wrong before every trip. And when an unpredictable combination of happenstances do occur and cause an accident, they redesign the failed processes and add a few new checks. Software developers in general haven't yet learned that discipline (not industry wide), as for most of our creations a complete stop is not life-threatening. I'm afraid they will be forced to adopt such practices when the first fully automated agents (likely, autonomous cars) start running into mishaps because of preventable misbehaviors.