3 ms·
That's impressive getting a 397B down to <110GB~. HF link is broken though!
by smcleod 5mo ago
That's impressive getting a 397B down to <110GB~. HF link is broken though!
- tarruda 5mo ago> That's impressive getting a 397B down to <110GB It is higher than 110GB. MacOS allows up to 125G of the RAM to be shared with GPU, so it is certainly less than that! > HF link is broken though! Doesn't seem broken to me, but you should be able to search for tarruda/Qwen3.5-397B-A17B-GGUF on huggingface.