3 ms·Zero-2 and DeepSpeed: Shattering Barriers of Deep Learning Speed and Scale6 points by headalgorithm 6y ago