4 ms·

Is it not possible to add Gemma support on Llama.cpp?

• austinvhuang 3y ago
  Gemma support has been added to llama.cpp, in fact it was added almost immediately after the release: https://twitter.com/ggerganov/status/1760293079313973408 https://twitter.com/ggerganov/status/1760293079313973408 However, be aware that there were some quality issues with quantization initially (hopefully they're resolved but i haven't followed too closely): https://twitter.com/ggerganov/status/1760418864418934922 https://twitter.com/ggerganov/status/1760418864418934922