3 ms·
Mixture of experts is different from ensembles because MoE happens at every layer as opposed to joining the models once at the end
by why_only_15 3y ago
Mixture of experts is different from ensembles because MoE happens at every layer as opposed to joining the models once at the end
- TeMPOraL 3y agoThanks, that makes sense - and isn't obvious from the explanations I see people give.