3 ms·
From the description it seems even the larger 120b model can run decently on a 64GB+ (Arm) Macbook? Anyone tried already? > Best with ≥60GB VRAM or unified mem
by OJFord 1y ago
From the description it seems even the larger 120b model can run decently on a 64GB+ (Arm) Macbook? Anyone tried already?
> Best with ≥60GB VRAM or unified memory
https://cookbook.openai.com/articles/gpt-oss/run-locally-ollama#pick-your-model https://cookbook.openai.com/articles/gpt-oss/run-locally-oll...
- tarruda 1y agoA 64GB MacBook would be a tight fit, if it works. There's a limit to how much RAM can be assigned to video, and you'd be constrained on what you can use while doing inference. Maybe there will be lower quants which use less memory, but you'd be much better served with 96+GB