The model is 17GB, so you'd need 24GB VRAM: https://huggingface.co/microsoft/Fara-7B/tree/main https://huggingface.co/microsoft/Fara-7B/tree/main If you want

The model is 17GB, so you'd need 24GB VRAM: https://huggingface.co/microsoft/Fara-7B/tree/main https://huggingface.co/microsoft/Fara-7B/tree/main If you want to find models which fit on your GPU, the easiest way is probably going to ollama.com/library For a general purpose model, try this one, which should fit on your card: https://ollama.com/library/gemma3:12b https://ollama.com/library/gemma3:12b If that doesn't work, the 4b version will definitely work.