3 ms·
Not really, the dispatching between experts happen for every word and every layer, so you can't easily isolate distinct models.
by gwenzek 6y ago
Not really, the dispatching between experts happen for every word and every layer, so you can't easily isolate distinct models.