But you see the process of training is a solution of the problem "how to program AI". For a machine to be intelligent it has to form it's own model of the world

But you see the process of training is a solution of the problem "how to program AI". For a machine to be intelligent it has to form it's own model of the world. This model is necessarily somewhat opaque because it includes representations which the machine has created for itself. An intelligent machine that is interpretable in a straightforward manner is an impossibility, it is a contradiction in terms. You can teach the machine to answer questions about it's internal state in order to analyse it's function or you can apply your own mind to painstakingly deduce it's operation. But I contend you cannot have a generalised rubric for determining it's operation.