4 ms·
Google's Gemma to run locally on Nvidia GPUs
- iAkashPaul 3y agoI've quantised 2B & 7B Instruct models here https://huggingface.co/iAkashPaul/gemma-2b-it-gguf https://huggingface.co/iAkashPaul/gemma-2b-it-gguf & https://huggingface.co/iAkashPaul/gemma-7b-it-gguf https://huggingface.co/iAkashPaul/gemma-7b-it-gguf
- yogorenapan 3y agoHow does this compare to Mixtral (especially the Dolphin and Orca fine tunes)?
- not_really 3y agoNot great, even when compared to Mistral 7b
- ecmascript 3y agoI'm assuming it won't run on my GPU though since I am a white man