2 ms·

Ah it was indeed just that! I'm now on: $ llama --version version: 8770 (82764d8) built with GNU 15.2.0 for Linux x86_64 (From Nix unstable) And this works

by teekert 6mo ago

Ah it was indeed just that! I'm now on: $ llama --version version: 8770 (82764d8) built with GNU 15.2.0 for Linux x86_64 (From Nix unstable) And this works as advertised, nice chat interface, but no openai API I guess, so no opencode...

homarp 6mo ago
check on same port, there is an OpenAI API https://github.com/ggml-org/llama.cpp/tree/master/tools/server#api-endpoints https://github.com/ggml-org/llama.cpp/tree/master/tools/serv...
- teekert 6mo ago
  Good stuff, thanx!