The only paper that I could find using an approach with fully separated experts like this is https://arxiv.org/pdf/2208.03306.pdf https://arxiv.org/pdf/2208.033

The only paper that I could find using an approach with fully separated experts like this is https://arxiv.org/pdf/2208.03306.pdf https://arxiv.org/pdf/2208.03306.pdf