3 ms·

NixOS has packages for llama-cpp and ollama: https://search.nixos.org/packages?channel=23.11&from=0&size=50&sort=relevance&type=packages&query=llama https://sea

NixOS has packages for llama-cpp and ollama: https://search.nixos.org/packages?channel=23.11&from=0&size=50&sort=relevance&type=packages&query=llama https://search.nixos.org/packages?channel=23.11&from=0&size=... Edit: And Arch packages ollama officially - https://archlinux.org/packages/?sort=&q=llama&maintainer=&flagged= https://archlinux.org/packages/?sort=&q=llama&maintainer=&fl... - and a few things in the AUR - https://aur.archlinux.org/packages?O=0&K=llama https://aur.archlinux.org/packages?O=0&K=llama

ghthor 3y ago
NixOS just got tabbyml[1] which is built on llama-cpp. Working on systemsd services the weekend and updating latest tabbyml release which supports rocm in addition to cuda [1] https://github.com/TabbyML/tabby https://github.com/TabbyML/tabby [2] https://github.com/NixOS/nixpkgs/pull/291744 https://github.com/NixOS/nixpkgs/pull/291744
- ghthor 3y ago
  Systemd service PR posted to nixpkgs https://github.com/NixOS/nixpkgs/pull/292873 https://github.com/NixOS/nixpkgs/pull/292873