3 ms·A 35B MoE on a 16 GB GPU, without the offload tax18 points by GreenGames 4mo agoGreenGames 4mo ago[flagged]