3 ms·
IMO the direction we're going seems more like having a few small models in a MoE that are equivalent to a current 200bn model
by csjh 3y ago
IMO the direction we're going seems more like having a few small models in a MoE that are equivalent to a current 200bn model