3 ms·
I don't have links handy but there is active research in this area.
by hedgehog 8mo ago
I don't have links handy but there is active research in this area.
- rao-v 8mo agoI'd love any keywords to search for to find active research on this topic!
- hedgehog 8mo agoMost of the work I'm aware of starts from the perspective of optimizing inference but the implication that pushing the lessons upstream gets mentioned here and there. Not All Models Suit Expert Offloading: On Local Routing Consistency of Mixture-of-Expert Models (https://arxiv.org/abs/2505.16056 https://arxiv.org/abs/2505.16056) Breaking the MoE LLM Trilemma: Dynamic Expert Clustering with Structured Compression (https://arxiv.org/abs/2510.02345 https://arxiv.org/abs/2510.02345)