6 ms·
Is there anything one can reasonably run on a mac mini M2 with just 24GB RAM or should I not even try?
by wila 2mo ago
Is there anything one can reasonably run on a mac mini M2 with just 24GB RAM or should I not even try?
- ch_sm 2mo agoIt depends on your use case, but the smaller Gemma 4 models or qwen3.6:9b would probably run OK on that. I recommend trying it, even just for fun. It‘s easy with omlx.
- wila 2mo agoOk, will see if I can find some time for play. Thanks.
- pornel 2mo agoNot enough for coding. 48GB is minimum for a non-lobotomized coding model like qwen, and you'd likely want 64GB to have long context and not kernel panic when Chrome opens. You could run one of the smaller Gemma models to have a chatty Wikipedia.
- wila 2mo agoFigured that would be the case. Thanks.