3 ms·

Qwen3 235B A22B GGUF bf16 is 470GB size lol that's 3x h100?

• aurareturn 2y ago
  No one inferences at bf16. It's always in 8 bit now. So you can fit comfortably in a 512GB Mac.