3 ms·
are there any that would run on 16GB Apple M1?
by zenmac 1y ago
are there any that would run on 16GB Apple M1?
- bigyabai 1y agoNot quite. The smallest Qwen3 A3B quants are ~12gb and use more like ~14gb depending on your context settings. You'll thrash the SSD pretty hard swapping it on a 16gb machine.