2 ms·
canirun doesn’t work well for MoE models. Qwen’s 35B A3B model works amazing on my M1 Max 32GB, but canirun thinks it barely runs.
by gcr 5mo ago
canirun doesn’t work well for MoE models. Qwen’s 35B A3B model works amazing on my M1 Max 32GB, but canirun thinks it barely runs.