4 ms·Deep Gradient Compression [pdf]2 points by stablemap 9y agostablemap 9y agoIn this paper, we find 99.9% of the gradient exchange in distributed SGD is redundant, and propose DGC to greatly reduce the communication bandwidth.