4 ms·
NixOS just got tabbyml[1] which is built on llama-cpp. Working on systemsd services the weekend and updating latest tabbyml release which supports rocm in addit
by ghthor 3y ago
NixOS just got tabbyml[1] which is built on llama-cpp. Working on systemsd services the weekend and updating latest tabbyml release which supports rocm in addition to cuda
[1] https://github.com/TabbyML/tabby https://github.com/TabbyML/tabby
[2] https://github.com/NixOS/nixpkgs/pull/291744 https://github.com/NixOS/nixpkgs/pull/291744
- ghthor 3y agoSystemd service PR posted to nixpkgs https://github.com/NixOS/nixpkgs/pull/292873 https://github.com/NixOS/nixpkgs/pull/292873