3 ms·
The main difference is setting everything up yourself manually, downloading the modal, optimizing the parameters for best performance, running an API server and
by mayankchhabra 3y ago
The main difference is setting everything up yourself manually, downloading the modal, optimizing the parameters for best performance, running an API server and a UI front-end - which is out of reach for most non-technical people. With LlamaGPT, it's just one command: `docker compose up -d` or one click install for umbrelOS home server users.
- SubiculumCode 3y agothanks. yeah, that IS useful. Anyone see if it contains utilities to import models from huggingface/github?
- DrPhish 3y agoMaybe I've been at this for too long and can't see the pitfalls of a normal user, but how is that easier than using an oobabooga one-click installer (an option that's been around "forever")? I guess ooba one-click doesn't come with a model included, but is that really enough of a hurdle to stop someone from getting it going? Maybe I'm not seeing the value proposition of this. Glad to be enlightened!
- ShamelessC 3y agoThe difference is that this project has both "GPT" and "llama" in its name, and used the proper HN-bait - "self hosted, offline, private". HN users (mostly) don't actually read or check anything and upvote mostly based on titles and subsequent early comments.
- Multicomp 3y agoAgreed. Gpt4all[1] offers a similar 'simple setup' but with application exe downloads, but is arguably more like open core because the gpt4all makers (nomic?) want to sell you the vector database addon stuff on top. [1]https://github.com/nomic-ai/gpt4all https://github.com/nomic-ai/gpt4all I like this one because it feels more private / is not being pushed by a company that can do a rug pull. This can still do a rug pull, but it would be harder to do.