3 ms·

Not OP but I am finding the Qwen 2.5 32b distilled with DeepSeek R1 model to be a good speed/smartness ratio on the M4 Pro Mac Mini.

• a1o 2y ago
  How much RAM?
  • Matl 2y ago
    It takes between 22GB-37GB depending on the context size etc. from what I've observed.
    • a1o 2y ago
      Thanks!
• bastardoperator 2y ago
  I'm running the same exact models.