2 ms·
Can anyone explain what this means?
by yodsanklai 3y ago
Can anyone explain what this means?
- ukuina 3y agoPossibly a huge leap forward in open-source model capability. GPT4's prowess supposedly comes from strong dataset + RLHF + MoE (Mixture of Experts). Mixtral brings MoE to an already-powerful model.