3 ms·
No. MoE tends to change expert every other word. There’s a bit of pattern (like a lot of punctuation to one expert) but it’s not clear what. Nobody understands
by ljlolel 2y ago
No. MoE tends to change expert every other word. There’s a bit of pattern (like a lot of punctuation to one expert) but it’s not clear what. Nobody understands how or why the router chooses the expert. It’s so early.
- j16sdiz 2y ago> Nobody understands how or why the router chooses the expert. It’s so early. Nobody understand how LLM works either. Is LLM as "early" as MoE ?
- xvector 2y agoLLMs are really well understood, what do you mean? You can see the precise activations and token probabilities for every next token. You can abliterate the network however you'd like to suppress or excite concepts of your choosing.
- ben_w 2y agoThere's various layers of understanding. If you will excuse analogy and anthropomorphism, the human analogy of what we do and don't understand about LLMs is, I think, that we understand quantum mechanics, cell chemistry, and overall connectivity (perceptrons, activation functions, and architecture) and group psychology (general dynamics of the output), but not specifically how some belief is stored (in both humans and LLMs).
- menaerus 2y agoMathematically speaking LLMs have very precise formulation and can be seen as F(context, X0, X1, ..., XP) = next_token. What science behind the LLMs is still lacking is how all these parameters are correlated one to each other and why one set of values is giving a better prediction than the other set of values. Right now, we arrive to these values through experimental approach, that is, through trainings.
- currymj 2y agoi think the younger generation who came up post deep learning, has a very very low bar for “understanding” because they never knew a world where SotA models worked in a way that made sense.
- htrp 2y ago> MoE tends to change expert every other word Any citation on this one?
- crystal_revenge 2y agoIt's covered in the original Mistral "Mixtral of Experts" paper [0]. 0. https://arxiv.org/abs/2401.04088 https://arxiv.org/abs/2401.04088
- Ey7NFZ3P0nzAe 2y agoI believe it's actually a per token routing, not a "every few words"
- regularfry 2y agoIt's mechanically capable of per-token routing, but the routing tends to be stable across more than one token. It's weird.
- qeternity 2y agoIt's got nothing to do with words, and many MoEs route to multiple experts per token (the well known Mixtral variants for example activates 2 experts per token).
- regularfry 2y agoWeirdly it does have to do with words, but not intentionally. Mechanically the routing is per-token, but the routing is frequently stable across a word as an emergent property. At least, that's how I read the mixtral paper.
- ljlolel 2y agoYep. Also note that I’m ELI5 so saying word is fine.
- deleted 2y ago[deleted]