3 ms·Google Brain’s Switch Transformer Language Model Packs 1.6T Parameters1 points by danielmorozoff 6y agodanielmorozoff 6y agoHere's the paper: https://arxiv.org/abs/2101.03961 https://arxiv.org/abs/2101.03961