2 ms·
Make sure you're using the "-it-qat" suffixed models like "gemma3:27b-it-qat"
by jinay 1y ago
Make sure you're using the "-it-qat" suffixed models like "gemma3:27b-it-qat"
- Zambyte 1y agoHere are the direct links: https://ollama.com/library/gemma3:27b-it-qat https://ollama.com/library/gemma3:27b-it-qat https://ollama.com/library/gemma3:12b-it-qat https://ollama.com/library/gemma3:12b-it-qat https://ollama.com/library/gemma3:4b-it-qat https://ollama.com/library/gemma3:4b-it-qat https://ollama.com/library/gemma3:1b-it-qat https://ollama.com/library/gemma3:1b-it-qat
- ein0p 1y agoThanks. I was wondering why my open-webui said that I already had the model. I bet a lot of people are making the same mistake I did and downloading just the old, post-quantized 27B.