4 ms·
It's on HuggingFace already: https://huggingface.co/google/gemma-2-9b https://huggingface.co/google/gemma-2-9b
by XzAeRosho 2y ago
It's on HuggingFace already: https://huggingface.co/google/gemma-2-9b https://huggingface.co/google/gemma-2-9b
- luke-stanley 2y agoI know the safe tensors are there, but I said GGUF 4-bit quantised, which is kinda the standard for useful local applications, a typical balanced sweet spot of performance and quality. It's makes it much easier to use, works in more places, be it personal devices or a server etc.