4 ms·
You should be able to run it locally w/ something like Ollama. It's been a while since I tinkered with the local LLM tools, but 1.5B is tiny, so it should run a
by colonial 2y ago
You should be able to run it locally w/ something like Ollama. It's been a while since I tinkered with the local LLM tools, but 1.5B is tiny, so it should run at a decent clip even on just your CPU.
`ollama run hf.co/bartowski/DeepSeek-R1-Distill-Qwen-1.5B-GGUF:F16` and you're off to the races.
- ac29 2y agoThere are official ollama models, no need to use HF https://ollama.com/library/deepseek-r1/tags https://ollama.com/library/deepseek-r1/tags