Wouldn't you be able to somehow couple it with another model that takes the NN data and somehow untangles it's convoluted logic into an isomorphic human readabl

Wouldn't you be able to somehow couple it with another model that takes the NN data and somehow untangles it's convoluted logic into an isomorphic human readable equation, ie. a model that has one task and that is translating NN logic into human equations. The training data could be real physics in a simulator held up against evolutionary driven AI logic that competes against it with various goals that are then evaluated and if given a high score then marked as isomorphic and given enough runs you'd get a dataset.