An ensemble of specialists is different to a mixture of experts? I thought half the point of MoE was to make the training tractable by allowing the different e

An ensemble of specialists is different to a mixture of experts? I thought half the point of MoE was to make the training tractable by allowing the different experts to be trained independently?