3 ms·
> run their own LLMs on Linux and the unfortunate answer was always that the existing options were slightly complicate What about https://github.com/ggerganov/
by dorfsmay 3y ago
> run their own LLMs on Linux and the unfortunate answer was always that the existing options were slightly complicate
What about https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp ?
It compiles and run easily on Linux.
- vorticalbox 3y agoOr https://gpt4all.io/index.html https://gpt4all.io/index.html Though doesn't currently support GPU.