Exactly. The tests are concerned with integrating the ML component into the broader picture of requirements and engineering. Engineers are not really interested

Exactly. The tests are concerned with integrating the ML component into the broader picture of requirements and engineering. Engineers are not really interested in why the statistics of a model is failing. And should never be (that's why testing model internals in TFML is an anti-pattern)