5 ms·
MacBook, thanks to Apple's new MLX framework.
by adastra22 3y ago
MacBook, thanks to Apple's new MLX framework.
- addandsubtract 3y agoWhich model can I use with 16GB ram? I tried Ollama with WizardCoder 7b, but it didn't work.
- adastra22 3y agoNot sure.. there was a benchmark article on the front page earlier today, but now I can't seem to find it.
- wenc 3y agoWhat didn’t work? I run Ollama on my M2 Pro and all models work.
- addandsubtract 3y agoI'm getting "Error: llama runner process has terminated" when trying to run the model. According to this ticket[1], it's a memory issue. Not sure why 16GB ram are struggling with a 7b model, though. [1] https://github.com/jmorganca/ollama/issues/1231 https://github.com/jmorganca/ollama/issues/1231
- wenc 3y agoCould you try another model like Mistral 7b and see if triggers the same error? (And check your available memory) I have 16GB too and have no trouble running even 13B models.
- addandsubtract 3y agoOh, interesting. Mistral:7b works, but wizardcoder:7b-python throws the same error as before. What's another good coding model to use besides wizardcoder? Edit: wizardcoder:7b-python-q4_1 throws the same error