3 ms·

I'm using: ollama run dolphin-mixtral:8x7b-v2.5-q3_K_S

• mark_l_watson 3y ago
  That runs on 32G? The original mixtral q3 wouldn’t run for me. Maybe the dolphin tuned version is smaller? EDIT: I just checked, it runs great, thanks.