4 ms·GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding2 points by baylearn 6y ago