4 ms·

For some tasks yes, and we don't know how many active parameters Luna is using..probably less than 27B

• Alifatisk 2mo ago
  Is Luna MoE? Had no idea OpenAi went that direction
  • kzrdude 2mo ago
    We don’t know but I think we assume that it is MoE or some almost equivalent sparse activation technology.
    • Alifatisk 2mo ago
      Right, I guess the ”Open” in OpenAI means open for speculation.