3 ms·It's still possible to transform the 8B model into a MOE with N x 8B with a few tricks.by visarga 3y agoIt's still possible to transform the 8B model into a MOE with N x 8B with a few tricks.