3 ms·
4-bit quantized 33b runs great on a mp pro with m3 max chip
by tarruda 3y ago
4-bit quantized 33b runs great on a mp pro with m3 max chip
- a_wild_dandan 3y agoI'm using the 5-bit quant with llama.cpp and it's excellent on my M2 96GB MacBook! Running this model + Mixtral will be fun.