We at AWS worked on this last year. We saw some promising results with our implementation with Apache MXNet DeepLearning framework. https://aws.amazon.com/blog

We at AWS worked on this last year. We saw some promising results with our implementation with Apache MXNet DeepLearning framework. https://aws.amazon.com/blogs/machine-learning/introducing-dynamic-training-for-deep-learning-with-amazon-ec2/ https://aws.amazon.com/blogs/machine-learning/introducing-dy... Good to see more work in this direction and we would be happy to collaborate on this.