3 ms·
> "Mixture Of Experts": An "MoE" is an approach in AI that combines multiple specialized AI models, known as "experts," (...) Wonder when that stopped being ca
by TeMPOraL 3y ago
> "Mixture Of Experts": An "MoE" is an approach in AI that combines multiple specialized AI models, known as "experts," (...)
Wonder when that stopped being called just an "ensemble model", which is a term I recall from 10 years ago. Terminology churn?
- why_only_15 3y agoMixture of experts is different from ensembles because MoE happens at every layer as opposed to joining the models once at the end
- TeMPOraL 3y agoThanks, that makes sense - and isn't obvious from the explanations I see people give.