What is really needed in the ML industry is a code independent "neural net interpreter" with an api that binds to any programming language. How hard is it to

What is really needed in the ML industry is a code independent "neural net interpreter" with an api that binds to any programming language. How hard is it to have a program that takes in neural network architectures & trained waits so as to do inference?