3 ms·
There are also prebuilt binary archives for just about any distribution and inference backend for the latest github release: https://github.com/ggml-org/llama.
by epihelix 2mo ago
There are also prebuilt binary archives for just about any distribution and inference backend for the latest github release:
https://github.com/ggml-org/llama.cpp/releases https://github.com/ggml-org/llama.cpp/releases
No need to compile unless you really need to.
- usagisushi 2mo agoThis. I use mise's github backend `mise use --global --pin github:ggml-org/llama.cpp` to grab the release binaries for Linux, Windows and macOS.