3 ms·
So the number of parameters metric here is the sum across all their models, right? There isn't yet a single model with 10 trillion parameters... right?
by IceMetalPunk 4y ago
So the number of parameters metric here is the sum across all their models, right? There isn't yet a single model with 10 trillion parameters... right?
- fishingboy 4y agoYes, it is the sum of all models. But M6-10T (MoE) of Alibaba is a 10 trillion one.