mayankchhabra

5 ms·

1.
by mayankchhabra 8mo ago
Hey HN, I’m one of the founders of Umbrel. We’ve spent the last 5 years building umbrelOS to make self-hosting accessible. Yesterday, we launched our dream hardware: Umbrel Pro. Specs: - 4x NVMe SSD slots for storage (tool-less operation) -
2.
Show HN: Umbrel Pro – 4x NVMe SSD home server (CNC aluminum and walnut)(umbrel.com)
2 points by mayankchhabra 8mo ago|8 comments
3.
Show HN: Files, the new self-hosted file browser on umbrelOS(youtube.com)
1 points by mayankchhabra 2y ago|0 comments
4.
by mayankchhabra 3y ago
It's fairly straightforward to add GPU support when running on the host, but LlamaGPT runs inside a Docker container, and that's where it gets a bit challenging.
5.
by mayankchhabra 3y ago
Not sure how powerful their NAS is, but on Umbrel Home (which has an N5105 CPU), it's pretty useable with ~3 tokens generated per second.
6.
by mayankchhabra 3y ago
It's powered by Nous Hermes Llama2 7b. From their docs: "This model stands out for its long responses, lower hallucination rate, and absence of OpenAI censorship mechanisms. [...] The model was trained almost entirely on synthetic
7.
by mayankchhabra 3y ago
The main difference is setting everything up yourself manually, downloading the modal, optimizing the parameters for best performance, running an API server and a UI front-end - which is out of reach for most non-technical people. With Llam
8.
by mayankchhabra 3y ago
Ah yes, running on GPU isn't supported at the moment. But CUDA (for Nvidia GPUs) and Metal support is on the roadmap!
9.
by mayankchhabra 3y ago
It's an entire app (with a chatbot UI) that takes away the technical legwork to run the model locally. It's a simple one line `docker compose up -d` on any machine, or one click install on umbrelOS home servers.
10.
by mayankchhabra 3y ago
Yes! It can run on any home server or cloud server.
11.
Show HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2(github.com)
225 points by mayankchhabra 3y ago|75 comments
12.
by mayankchhabra 3y ago
Ah unfortunately that's not supported. When running umbrelOS on a Raspberry Pi, it stores everything on the HDD/SSD you connect to the Pi on install to make sure your data isn't susceptible to microSD card's wear and tea
13.
by mayankchhabra 3y ago
Curious what aspects of Umbrel do you find not satisfactory? I know you said you'd like to see something less crypto focused. Is it the selection of crypto-oriented apps in the app store that you don't like to see? (And I totally
14.
Show HN: A powerful, compact home server for self-hosting(umbrel.com)
13 points by mayankchhabra 3y ago|4 comments
15.
Plex, Jellyfin, Transmission are now available on Umbrel home server OS(twitter.com)
1 points by mayankchhabra 4y ago|0 comments
16.
by mayankchhabra 4y ago
Thanks for the taking the time to try Umbrel out, great observations! 1. Re crypto apps, I figured some additional context may help. Before our today's release, Umbrel was a self-hosting OS primarily geared towards Bitcoin node users.
17.
by mayankchhabra 4y ago
I agree, that's my least favorite part of the site as well. We'll update it with a browsable directory of all the available apps in our app store soon.
18.
by mayankchhabra 4y ago
Thanks for the insightful reply. Everything you said makes total sense. Re noncommercial organizations being permitted users, this was a conscious decision on our part. We're purposefully building Umbrel purely for consumers, and don&#
19.
by mayankchhabra 4y ago
Licensing is a nuanced subject so we've written a detailed post on it. But in short, our license grants you the same rights that come with an open source license, except the right to sell or commercialize Umbrel. Here's our post t
20.
by mayankchhabra 4y ago
Umbrel's source code is public and there's no vendor lock-in: https://github.com/getumbrel/umbrel
21.
Show HN: Umbrel – A personal server OS for self-hosting(umbrel.com)
225 points by mayankchhabra 4y ago|135 comments