Oh that sounds interesting. Do you know what happened to it? I think I found it here: https://github.com/bryancatanzaro/copperhead https://github.com/bryancata

Oh that sounds interesting. Do you know what happened to it? I think I found it here: https://github.com/bryancatanzaro/copperhead https://github.com/bryancatanzaro/copperhead But I'm not sure what the state is. Looks dead (last commit 8 years ago). Probably just a proof of concept. But why hasn't this been continued? Blog post and example: https://developer.nvidia.com/blog/copperhead-data-parallel-python/ https://developer.nvidia.com/blog/copperhead-data-parallel-p... https://github.com/bryancatanzaro/copperhead/blob/master/samples/axpy.py https://github.com/bryancatanzaro/copperhead/blob/master/sam... Btw, for compiling on-the-fly from a string, I made something similar for our RETURNN project. Example for LSTM: https://github.com/rwth-i6/returnn/blob/a5eaa4ab1bfd5f157628fe375bb9b2995bf6b2bc/returnn/native_op.py#L1044 https://github.com/rwth-i6/returnn/blob/a5eaa4ab1bfd5f157628... This is made in a way that it compiles automatically into an op for Theano or TensorFlow (PyTorch could easily be added as well) and for both CPU and CUDA/GPU.