3 ms·Try llama.cpp - it usually excels with these MoE models imho.by johnnyApplePRNG 8mo agoTry llama.cpp - it usually excels with these MoE models imho.