3 ms·

Very interesting. Is this compatible with MoE architectures? I'm not too familiar with how this works.

• kzrdude 1mo ago
  It is compatible, and Qwen3.8 Flash Next is MoE
• kzrdude 1mo ago
  By the way; I found that DeepSeek says that it is even an "ideal complement to modern MoE architecture" https://arxiv.org/abs/2601.07372v1 https://arxiv.org/abs/2601.07372v1