3 ms·
FWIW, 405B not working with Ollama on a Mac M3-pro Max with 128GB RAM. Times out.
by raminf 2y ago
FWIW, 405B not working with Ollama on a Mac M3-pro Max with 128GB RAM.
Times out.
- pbmonster 2y agoDid you get a 2 bit quant? You need to chain several Mac Studios via Exo to get enough memory for a useful quant to work.