3 ms·
M4 is going to be too weak on GPU, even an M4 pro is probably not going to get you far. If you go with an M4, 16 or 32 is fine. An M1/M2/M3/M4 Max is probably w
by seanmcdirmid 2y ago
M4 is going to be too weak on GPU, even an M4 pro is probably not going to get you far. If you go with an M4, 16 or 32 is fine. An M1/M2/M3/M4 Max is probably what you need minimum to run quantized 72b models, where 64GB is needed.