AWS / MSR response to dynamic graph computation paradigms such as Chainer, Tensorflow Fold. There is certainly a distribution advantage to having this be the de

AWS / MSR response to dynamic graph computation paradigms such as Chainer, Tensorflow Fold. There is certainly a distribution advantage to having this be the default backend engine as so many store their data on S3, Redhsift. The DyNet paper is still the best source for background on the relative advantages to using "Define-By-Run" networks: DyNet: The Dynamic Neural Network Toolkit https://arxiv.org/pdf/1701.03980v1.pdf https://arxiv.org/pdf/1701.03980v1.pdf Now I just need to get to where scaling to 1000 GPUs is a problem I actually have ;)