4 ms·
Deepseek-coder-6.7B really is a quite surprisingly capable model. It's easy to give it a spin with ollama via `ollama run deepseek-coder:6.7b`.
by danielbln 3y ago
Deepseek-coder-6.7B really is a quite surprisingly capable model. It's easy to give it a spin with ollama via `ollama run deepseek-coder:6.7b`.
- triyambakam 3y agoThanks for the tip with ollama
- behnamoh 3y agoollama is actually not a great way to run these models as it makes it difficult to change server parameters and doesn't use `mlock` to keep the models in memory.
- discordance 3y agoIf you do: 1. ollama run deepseek-coder:6.7b 2. pip install litellm 3. litellm --model deepseek-coder:6.7b You will have a local OpenAI compatible API for it.