3 ms·
It's a bit like asking what flavour of icecream is the best. Try a few and see. For 16gb and speed you could try Qwen3-30B-A3B with some offload to system ram
by Havoc 1y ago
It's a bit like asking what flavour of icecream is the best. Try a few and see.
For 16gb and speed you could try Qwen3-30B-A3B with some offload to system ram or use a dense model Probably a 14B quant