3 ms·
It's a 119B model, 6B active. That's still 3-10x smaller than the other models in that graph though (400B, 1T, 1.5T).
by andai 4mo ago
It's a 119B model, 6B active.
That's still 3-10x smaller than the other models in that graph though (400B, 1T, 1.5T).