3 ms·
Isn't this the whole idea with Mixture Of Experts approach that is GPT-4 is using?
by worldsayshi 3y ago
Isn't this the whole idea with Mixture Of Experts approach that is GPT-4 is using?
- htrp 3y agoIsn't MoE with switch transformers massively inefficiemt compared to being able to customize which LLMs you are using? I've seen a lot of agent swarm concepts in the smaller llm space that seem to provide some feedback that this is a viable avenue of research.
- esafak 3y agoIs GPT-4's MOE based on combining specialized models?