I'm wondering if it might not be a good solution for >some< layers in a deep network, i.e. it's just another building block - practically I'm wondering just how

I'm wondering if it might not be a good solution for >some< layers in a deep network, i.e. it's just another building block - practically I'm wondering just how far this puppy can distribute over gpus, and if you could pipeline the whole thing - i dunno tho, as far as I've gotten is that it might be an interesting experiment - and I don't want to get completely sidetracked by an ODE solver :-)