To some extent this is already happening in languages popular for machine learning. Libraries are written in C/C++ and the users just glue things together with

To some extent this is already happening in languages popular for machine learning. Libraries are written in C/C++ and the users just glue things together with very accessible API's.