3 ms·

Which honestly is the easiest option of them all if you own an Apple Silicon based Mac. You just download the ollama and then run `ollama run mixtral` (or choos

by M4v3R 3y ago

Which honestly is the easiest option of them all if you own an Apple Silicon based Mac. You just download the ollama and then run `ollama run mixtral` (or choose a quantization from their models page if you don't have enough ram to run the defalt q4 model) and that's it.

deleted 3y ago
[deleted]
eurekin 3y ago
I tried an hour ago and had a can't load model error. Everything up to date. Is there any special step?
- mmcclure 3y ago
  Tried `ollama pull mixtral` just now and it seems to be working, albeit pretty slowly.
- Casteil 3y ago
  How much RAM do you have? Mixtral is a beast and the non quantized model wants 40GB+ of memory.
  - eurekin 3y ago
    Ah, that might be it! I have only 32
    - ukuina 3y ago
      The q2 should fit.