2 ms·

And more context: Same score as the latest DeepSeek Flash 0731 which has 284B parameters! (13B active) Its also the second best Qwen model, much better than Q

by bertili 2mo ago

And more context: Same score as the latest DeepSeek Flash 0731 which has 284B parameters! (13B active) Its also the second best Qwen model, much better than Qwen 3.7 Max, but significantly below Qwen 3.8 Max.

anthonypasq 2mo ago
isnt the active parameter count more relevant than the total? qwen is a dense model no?
- kzrdude 2mo ago
  For some tasks yes, and we don't know how many active parameters Luna is using..probably less than 27B
  - Alifatisk 2mo ago
    Is Luna MoE? Had no idea OpenAi went that direction
    - kzrdude 2mo ago
      We don’t know but I think we assume that it is MoE or some almost equivalent sparse activation technology.
      - Alifatisk 2mo ago
        Right, I guess the ”Open” in OpenAI means open for speculation.