3 ms·
GPT4 uses that MoE approach so its effectively a fine-tuned model for about a dozen different domain spaces.
by htrp 3y ago
GPT4 uses that MoE approach so its effectively a fine-tuned model for about a dozen different domain spaces.
- famouswaffles 3y agoNot really. That's not what/how MoE models work. It's not an ensemble.