5 ms·
Could you try another model like Mistral 7b and see if triggers the same error? (And check your available memory) I have 16GB too and have no trouble running e
by wenc 3y ago
Could you try another model like Mistral 7b and see if triggers the same error? (And check your available memory)
I have 16GB too and have no trouble running even 13B models.
- addandsubtract 3y agoOh, interesting. Mistral:7b works, but wizardcoder:7b-python throws the same error as before. What's another good coding model to use besides wizardcoder? Edit: wizardcoder:7b-python-q4_1 throws the same error