3 ms·
Could it be some sort of permanently routed MoE where they detect and switch for the whole prompt instead of token by token?
by l33tman 2mo ago
Could it be some sort of permanently routed MoE where they detect and switch for the whole prompt instead of token by token?