3 ms·
I wish when someone publishes something like this included the amount of RAM required! It spits the value out when it runs. And include which specific Apple Sil
by idcrook 2y ago
I wish when someone publishes something like this included the amount of RAM required! It spits the value out when it runs. And include which specific Apple Silicon CPU.
This Qwen3-30B-A3B-8bit - how much RAM under MLX?
My 16GB Apple Silicon Macs want to play.
- hadlock 2y agoWith 16gb you can comfortably run a 12b model that's been quantized. Quantizing is (bad example) effectively lossy compression.