With other forms of software you can se under the hood and (at least attempt to) control it. Ofcourse noone is perfect and every software has bugs but you stil

With other forms of software you can se under the hood and (at least attempt to) control it. Ofcourse noone is perfect and every software has bugs but you still have a certain degree of checks and controls. AI (the current form of it) is a blackbox that noone can understand. All the team can now see is that for this training input it arrived at these Set of weights for it's internal mapping. There is no meaning to those weights. There is no answer to the question "what steps did you take to make sure of this result". In other Forms of software the answer is easy. here are the design docs and the why, here are our procedures to verify to the best of our abilities. In AI the answer is "we threw these training set to wall, and these are the weights that sticked to it". There is no "to the best of our abilities in this process.