Physical systems are probabilistic. Environmental conditions are probabilistic. And we've been trusting our safety to physical products operating in the real wo

Physical systems are probabilistic. Environmental conditions are probabilistic. And we've been trusting our safety to physical products operating in the real world for a long time. Whether physical or ML or whatever ... There's always some process that you can't characterize to your liking. So you explore mitigation options until you can make a decision about whether to accept the risk. Standards and regulations enforce that you went through those steps to get a reasonably trustworthy result. Then liability law applies in the usual way. Actuaries and accountants tell you what it's going to cost you, and market research tells you how much it might sell for. Inability to control or understand what you built doesn't absolve you of any fault or responsibility. All it does is change your risk acceptance criteria.