4 ms·Is Luna MoE? Had no idea OpenAi went that directionby Alifatisk 2mo agoIs Luna MoE? Had no idea OpenAi went that directionkzrdude 2mo agoWe don’t know but I think we assume that it is MoE or some almost equivalent sparse activation technology.Alifatisk 2mo agoRight, I guess the ”Open” in OpenAI means open for speculation.