3 ms·
It's feasible to put the expert routing logic in a previous layer. People have done it: https://arxiv.org/abs/2507.20984 https://arxiv.org/abs/2507.20984
by yorwba 7mo ago
It's feasible to put the expert routing logic in a previous layer. People have done it: https://arxiv.org/abs/2507.20984 https://arxiv.org/abs/2507.20984