3 ms·
are there plans to release an official GGUF version to use with llama.ccp?
by vorticalbox 3y ago
are there plans to release an official GGUF version to use with llama.ccp?
- espadrine 3y agoIt is already part of the release on Huggingface: https://huggingface.co/google/gemma-7b/blob/main/gemma-7b.gguf https://huggingface.co/google/gemma-7b/blob/main/gemma-7b.gg... It is a pretty clean release! I had some 500 issues with Kaggle validating my license approval, so you might too, but after a few attempts I could access the model.
- vorticalbox 3y agoI didn't see this when searching thanks