3 ms·
just so you know, you can grab any gguf from huggingface and specify the quant like this: ollama pull hf.co/bartowski/nvidia_OpenCodeReasoning-Nemotron-7B-GG
by fouc 1y ago
just so you know, you can grab any gguf from huggingface and specify the quant like this:
ollama pull hf.co/bartowski/nvidia_OpenCodeReasoning-Nemotron-7B-GGUF:IQ4_XS