3 ms·

But it is easy ... clone the git repo, make a build dir, cd into it, run cmake .., run build/bin/llama-server -m /path/to/model.gguf Browse to served web page

But it is easy ... clone the git repo, make a build dir, cd into it, run cmake .., run build/bin/llama-server -m /path/to/model.gguf Browse to served web page with chat UI.... By "easy" do you mean "very lazy"?

pinkmoonx 2mo ago
[dead]
- 72deluxe 2mo ago
  Haha ok, like click & run sort of levels? They do package builds on their github releases depending on your architecture (CUDA or not etc.) so it should be close to "very lazy" levels of ease. I find it useful, but the models I run are pretty rubbish due to my lack of RAM, which is a pity.
  - greenmoonx 2mo ago
    [flagged]