3 ms·
There are network architectures for MoE, but afaik the concept of MoE is separate from them. MoE at least significantly predates the last decade's neural networ
by 6gvONxR4sf7o 3y ago
There are network architectures for MoE, but afaik the concept of MoE is separate from them. MoE at least significantly predates the last decade's neural network boom.
- andreyk 3y agoafaik the term MoE is generally used in the context of neural networks, with the term mixture models being more general. But you are right it's not exclusive to NNs.