With 8GB VRAM, I would try this one first: https://ollama.com/library/qwen3:8b-q4_K_M https://ollama.com/library/qwen3:8b-q4_K_M For fast inference, you want

With 8GB VRAM, I would try this one first: https://ollama.com/library/qwen3:8b-q4_K_M https://ollama.com/library/qwen3:8b-q4_K_M For fast inference, you want a model that will fit in VRAM, so that none of the layers need to be offloaded to the CPU.