3 ms·It's a 600B+ mixture of experts and yes it's described in the paper, GitHub, etc.by lopuhin 2y agoIt's a 600B+ mixture of experts and yes it's described in the paper, GitHub, etc.