3 ms·
This is now the 4th distributed deep learning solution built on AllReduce/MPI (after Baidu, Facebook, and IBM). There seems to be convergence on AllReduce/MPI/I
by jamesblonde 9y ago
This is now the 4th distributed deep learning solution built on AllReduce/MPI (after Baidu, Facebook, and IBM). There seems to be convergence on AllReduce/MPI/Inifiniband and synchronous distributed SGD as the way to scale-out distributed deep learning. Interesting.