2 ms·
MoE models don't work like that though
by famouswaffles 3y ago
MoE models don't work like that though
- SgtBastard 3y agoToken-at-time MoE models could result in mid-output-stream directional change. I agree with you that whole-output MoE models don’t.