Explainability is important - understanding why and how, but when it comes to the what the issue is accountability. If you are dragged up in court and accused o

Explainability is important - understanding why and how, but when it comes to the what the issue is accountability. If you are dragged up in court and accused of manslaughter (hello 5 years in an open prison) then you really want to be able to say, hand on heart, that what you did was professional and that you could reasonably have expected "not to kill". "I A/B tested it and everything checked out" isn't going to cut it. Also; the nights in the prison cell contemplating that you are held responsible for offing some poor sod. Not so good.