3 ms·
The switch transformer has already achieved a trillion parameters. https://arxiv.org/abs/2101.03961 https://arxiv.org/abs/2101.03961
by dustfinger 5y ago
The switch transformer has already achieved a trillion parameters.
https://arxiv.org/abs/2101.03961 https://arxiv.org/abs/2101.03961