3 ms·Most likely it's a MoE of Grok-0 which would be 8x33B + 50B for the router.by moffkalast 3y agoMost likely it's a MoE of Grok-0 which would be 8x33B + 50B for the router.