3 ms·
Horovod: Uber’s Open Source Distributed Deep Learning Framework for TensorFlow
- jamesblonde 9y agoThis is now the 4th distributed deep learning solution built on AllReduce/MPI (after Baidu, Facebook, and IBM). There seems to be convergence on AllReduce/MPI/Inifiniband and synchronous distributed SGD as the way to scale-out distributed deep learning. Interesting.