3 ms·
I think it did with Mixtral and MoE. I think people talk about the models because the architectural details are generally inaccessible for us since we don't ha
by ilaksh 3y ago
I think it did with Mixtral and MoE.
I think people talk about the models because the architectural details are generally inaccessible for us since we don't have sufficient training (which it requires quite a lot to have an intuitive understanding I believe). Whereas the models are easily downloaded and tested.