4 ms·
If you accept the "ggml-org": https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/tree/main https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/tree/mai... ht
by mdp2021 5mo ago
If you accept the "ggml-org":
https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/tree/main https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/tree/mai...
https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/blob/main/gemma-4-12B-it-Q8_0.gguf https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/blob/mai...
- zkmon 5mo agoDo they run well on vLLM?