>(that's why they "copped out" and did MoE for ChatGPT) MoE outperform dense counterparts significantly after instruct tuning. https://arxiv.org/abs/2305.14705

>(that's why they "copped out" and did MoE for ChatGPT) MoE outperform dense counterparts significantly after instruct tuning. https://arxiv.org/abs/2305.14705 https://arxiv.org/abs/2305.14705