7 ms·
Note that the OP repo doesn't yet support GGUF format.
by seaal 3y ago
Note that the OP repo doesn't yet support GGUF format.
- keyle 3y agoYes it does. Or do you mean the OP's github repo?
- seaal 3y agoYeah I was referring to OP, oops >We currently support models in GGML format. However, the GGML format has now been superseded by GGUF. >Future versions of OnPrem.LLM will use the newer GGUF format.
- kgwgk 3y agoWhat do you mean? https://github.com/ggerganov/llama.cpp/releases/tag/master-6381d4e https://github.com/ggerganov/llama.cpp/releases/tag/master-6...