4 ms·
It's actually not the largest. https://huggingface.co/google/switch-c-2048 https://huggingface.co/google/switch-c-2048 is 1.6T parameters.
by zone411 3y ago
It's actually not the largest. https://huggingface.co/google/switch-c-2048 https://huggingface.co/google/switch-c-2048 is 1.6T parameters.
- WeMoveOn 3y agobut is switch c even usable? iirc the training set was nowhere near enough for a model of that size to be coherent in a conversation