2 ms·
I think you are an optimist here. I can barely run mixtral-8x-7B on my M2 Pro 32G Mac, but I am grateful to be able to run it at all.
by mark_l_watson 3y ago
I think you are an optimist here. I can barely run mixtral-8x-7B on my M2 Pro 32G Mac, but I am grateful to be able to run it at all.
- JanisErdmanis 3y agoWhich quantization level are you using?
- mark_l_watson 3y agoQ2, so not so great. I usually run other models. I would be embarrassed to tell you how long my “ollama list” is.