3 ms·
Llama.cpp team has failed to make their tech easy to install and use for years. Why can’t they figure it out???
by redmoonx 2mo ago
Llama.cpp team has failed to make their tech easy to install and use for years.
Why can’t they figure it out???
- 72deluxe 2mo agoBut it is easy ... clone the git repo, make a build dir, cd into it, run cmake .., run build/bin/llama-server -m /path/to/model.gguf Browse to served web page with chat UI.... By "easy" do you mean "very lazy"?
- pinkmoonx 2mo ago[dead]
- 72deluxe 2mo agoHaha ok, like click & run sort of levels? They do package builds on their github releases depending on your architecture (CUDA or not etc.) so it should be close to "very lazy" levels of ease. I find it useful, but the models I run are pretty rubbish due to my lack of RAM, which is a pity.
- greenmoonx 2mo ago[flagged]
- walrus01 2mo agoThis is like complaining that the mariadb team has failed to make their tech easy to use. It's a server side piece of software. There are plenty of user friendly GUIs or wrappers for it. lm-studio or unsloth are to llama.cpp as something like phpmyadmin is to mysql/mariadb.
- greenmoonx 2mo ago[dead]