3 ms·
397B params, 17B activated at the same time Those 17B might be split among multiple experts that are activated simultaneously
by wongarsu 7mo ago
397B params, 17B activated at the same time
Those 17B might be split among multiple experts that are activated simultaneously