3 ms·
I don’t see why this would happen when the modern models already use MoE, which gives them most of the benefits of having specialized models.
by MattRix 6mo ago
I don’t see why this would happen when the modern models already use MoE, which gives them most of the benefits of having specialized models.