21 ms·
Self-Host All the Things?
- flakeoil 4y agoIf you have a family and your family uses all this self-hosted stuff (backup, file storage, email etc), what would happen when you die or get a serious health issue? Do you think your spouse or kids can get the data out themselves? No-one will have a clue where the backups are, how the emails are stored, where those pics are etc. And even more difficult in case you have implemented some clever encryption and 2-factor etc. We all think it's simple. It's just to copy the files from "that" folder on the server to your own machine or a USB disk, but it is not so easy in practice for most people. Even for someone competent it can be difficult to sort through the mess if it is not well documented. I say this as someone who hosts the backup and all the pics on a NAS.
- romwell 4y ago> Do you think your spouse or kids can get the data out themselves? No-one will have a clue where the backups are, how the emails are stored, where those pics are etc. As opposed to what, your spouse having no idea which cloud services you used for file storage, what login credentials you had, and having no ability to access those accounts? > Even for someone competent it can be difficult to sort through the mess if it is not well documented. The most difficult part is sorting through the mess, however it is documented. It's been three years since my father's passing, and I have yet to open his laptop. I can't. I don't need any credentials to access the box of old family photos to get them scanned, and yet it's still an item on the to-do list.
- ptman 4y agoSelf-host in the cloud for free https://paul.totterman.name/posts/free-clouds/ https://paul.totterman.name/posts/free-clouds/
- RamblingCTO 4y agoAlthough I self host some stuff (forgejo, gotosocial, blog) I think it's pretty inefficient when it comes to energy and thus emissions.
- speleding 4y agoAs a Calendly alternative I would recommend SuperSaaS[1]. Not open source, but free for small users (<50 appointments) and much more customisable / flexible, extend with your own API / web hooks / CSS. (Disclosure: I built it) [1] https://www.supersaas.com/ https://www.supersaas.com/
- jrm4 4y agoHelp me out here: I do a lot of this "self-hosting stuff," I have fiber internet. And a whole lot of y'all talk about what feels like a TON of overkill. I still don't really get what kubernetes is (20 year Linux user) or the necessity of buying a "server" for this purpose. I use (what is relatively old) a $200 office desktop from someones surplus (Dell Optiplex 900-something, I don't even remember because it's in the closet) and Ubuntu+Docker handles everything I throw at it, easy?
- stefandesu 4y agoI agree. I have one of those fairly efficient mini PCs also running Ubuntu+Docker and it's totally fine for my use-case. I don't need 100% uptime (or even 99%) and nightly backups are more than sufficient. I can spin up an equivalent machine in about an hour from backup if necessary. (I could spend some time learning Ansible to automate this further.)
- jrm4 4y agoRight? I live in North Florida, meaning "the power will go out 7-10 times a year," so my "uptime" is not important at all, just "the thing in the bios that automatically turns the computer on without pressing the button when it recieves power" I don't need access to the music and TV shows with no TV/stereo to play them on :) READ A BOOK, kids.
- hermannj314 4y agoBut Google uses Kubernetes so you have to use it. My plumbing can barely scale to handle a dinner party, but apparently my home lab needs to be ready to provision nodes if I ever find 2 billion people in my living room.
- XCSme 4y agoSometimes I still host things on LAMP servers, there are many apps/websites/platforms that just use PHP/MySQL so I can just upload some files or edit them directly on the server.
- cdeutsch 4y agono
- freitzkriesler2 4y agoSelf hosting is great , except it's incredibly frustrating to get a good pipe to your home that has decent upload speeds. Even "business class " is downright awful. Thankfully this is slowly changing but not fast enough! Looking to run my own next cloud instance soon.
- kornhole 4y agoIf you have high bandwidth requirements, you can self-host on a VPS from the many possible providers. I personally have a hybrid setup with my high storage and resource intensive apps such as Nextcloud hosted on a server at home but host services that need high bandwidth, no NAT restrictions, and different security on a VPS. Yes I pay a small subscription to the VPS provider, but it is relatively small.
- dijit 4y agoI guess that depends on where you live, I have almost the same upload vs download speed on my ISP Bahnhof in Sweden. Proof: https://www.speedtest.net/result/14437484691.png https://www.speedtest.net/result/14437484691.png I am always worried about someone deciding to DDoS me though.
- Nextgrid 4y agoTo be fair, they can do that just fine regardless of whether you’re running externally-available services. Most untargeted, low-effort DDoS relies on filling up all your bandwidth with spam traffic, not exploiting some layer-7 vulnerability in an application you host.
- charcircuit 4y agoWho does untargetted layer 3/4 DDoS? Why would an attacker waste money booting a website that gets 0 visitors?
- dijit 4y agoBy "untargetted" the parent almost certainly means "not tailored to take down the site". Some people do smart things and find a page that is heavy for your computer to process and hit it a lot. Some people decide they don't like your service (or you) and flood you.
- MuffinFlavored 4y ago> Email newsletter tools: Old or new, your pick Am I wrong to think that most businesses/people pay for Mailchimp because getting your e-mail actually delivered into the inboxes of your target audience/customers is non-trivial? aka, you're going to end up in "spam" otherwise? I find it hard to believe that you can "free-ly" send e-mail to, say, 100,000 e-mails and actually have it get delivered at a high rate? I would love to learn if I'm wrong though. This article could've talked about DataDog vs Jaeger/ELK stack I think for tracing/logs.
- dijit 4y ago> I find it hard to believe that you can "free-ly" send e-mail to, say, 100,000 e-mails and actually have it get delivered at a high rate? I would love to learn if I'm wrong though. You can do this, I have done this, but honestly it's annoyingly painful and you're always one bad ad campaign away from being nuked to death by people marking your emails as spam. There's a lot of rules to follow and even when you follow them you need to ensure that you start emailing a low volume for each new sending IP until the reputation grows over time.
- Breza 4y agoThis is the correct answer. I work at a company that sends millions of emails every week from our self-hosted IP range. If you have a high quality list of recipients who actually want to hear from you and warm up your IPs gradually, you can be successful.
- Nextgrid 4y agoTo be fair, if people are marking your emails as spam frequently enough to get your IPs/domains blacklisted then it suggests the system is working as designed and you shouldn’t be sending whatever you’re sending to those people.
- dijit 4y agoNah, about 2% of my "Thank you for ordering, here is your receipt" mails also get marked as spam. Some number of people just smack the "spam" button for nearly everything that is automated, and those "spam" buttons seem to work on absolute numbers not percentages; so if you have a high number of people in the pool then you will be false flagged eventually. We had a very explicit double opt-in system, made it super easy to unsubscribe, emailed once a month at most; and we had people still marking our communications as spam. I'm not sure what else we could have done to weed out the people who just smack the spam button honestly. That said, there was a lot of variance, emoji in the headline was the campaign that caused 9% of people to mark spam and 20% to unsubscribe, but it was enough to have us blackholed for 2.5 months. I think a major issue is that people don't want to even check how to unsubscribe and they see the “mark as spam” button as a “just make this go away” button.
- cuuupid 4y agoCal.com’s issues have less to do with the stack and more that it just isn’t setup for self hosting , if you try to get it up and running you’ll notice you get quite a few errors where it tries to hit proprietary code and it crashes strangely every few hours. Also uses up an incredulous amount of resources for such a simple service.
- spiderfarmer 4y agohttps://mailcoach.app/ https://mailcoach.app/ is another awesome self hosted Mailchimp alternative, especially when you’re developing Laravel applications.
- justin_oaks 4y agoI thought this article would go into more than a handful of apps. What apps do you think work well for self-hosting, even if it limited to us tech folk? I've self-hosted Grafana and InfluxDB for monitoring and metrics and found them OK to self host. The authentication and TLS setups were the most annoying. I've self hosted a few kinds of wiki software, but I eventually settled on a combination of a single Tiddlywiki file and uploading to S3. It works well for most of my own knowledge storage. I even went so far as to write my own plugin to save the Tiddlywiki file to S3, so I can press a button in Tiddlywiki to upload it. I have a self-hosted docker registry, which is just the reference repository provided by Docker. It has required almost no maintenance since I set it up. [Edit: for clarity]
- boguscoder 4y ago+1 to influxDB (I use older Chronograf instead of Graphana) for home automation/ sensor monitoring, even on Rpi Zero hosting was very easy to start and zero maintenance from there
- nitnelave 4y agoI got fed up installing OpenLDAP for user management, so I made LLDAP, targeting the Goldilocks zone of the article: simple to setup/manage, but powerful enough for most self-hosting needs.
- justin_oaks 4y agoAwesome! Next time I'm looking to set up some user management stuff, I'll have to try it out. I especially appreciate the sample configurations you give for each service you are trying to integrate with.
- navigate8310 4y agoCan something like this be used to host phone books for IP PBX?
- nitnelave 4y ago
- Axsuul 4y agoLoving the "just right" labels. How does n8n compare to Activepieces? Also those who are looking to dive deeper into self-hosting should join us at /r/selfhosted on Reddit.
- ashrafsam 4y agoCreator of Activepieces here; we do our best to design for the simplest user so we keep our UX as straightforward and non-technical as possible. Our license is very permissive (MIT), and we encourage community collaboration on pieces which made us grow very fast to 41 pieces until today. Here is our HN launch about a month ago: https://news.ycombinator.com/item?id=34723989 https://news.ycombinator.com/item?id=34723989 And this is our /r/selfhosted launch: https://www.reddit.com/r/selfhosted/comments/10pxkao/we_built_activepieces_open_source_alternative_to/ https://www.reddit.com/r/selfhosted/comments/10pxkao/we_buil...
- Axsuul 4y agoThanks!
- unixhero 4y agoSelf host with vps Use cloudron.io for provisioning Profit
- margorczynski 4y agoIt looks like a proprietary, closed-source solution so not sure if that's such a great idea in the long run.
- unixhero 4y agoUsed it for 5 years in production, it is a good idea
- oarsinsync 4y agoI used google reader for 6 years.
- unixhero 4y agoWhere did it get you though?
- oarsinsync 4y agoIt got me lots of good ideas. Until I gave up following all my RSS feeds when it shutdown. Now I get fewer good ideas.
- cloakedcode 4y agoThe original post is about self hosting to get away from vendor lock-in. Using something like this defeats the purpose a little.
- tweetle_beetle 4y agoMaybe not in the long run, but more reliable than community created scripts which may or may not be: up to date, migrate data correctly, etc. They all suffer from it, but it's especially the non-Docker ones like Yunohost that seem to be worse in my experience. Anyway even if Cloudron goes under, you still have your own data on your own machine if youve set it up like that.
- margorczynski 4y agoAs for hosting your own apps I found Hetzner VPS or something similar to be very good. Just pack them up into a docker-compose with your CI/CR pushing an image into a repository and you can host a lot of low-medium traffic solutions on a single box with the cost being a fraction of "the Cloud" (especially PaaS). On the box there is a single Nginx acting as a reverse proxy to the exposed compose ports offloading SSL. In such a solution you just need to ask yourself should Postgres, Grafana etc. be shared between the apps or put into each one of the compose configs as a service and handled separately. Both have their upsides and downsides.
- contradictioned 4y agoI have something similar, but with traefik instead of nginx. Traefik integrates very nicely with docker using labels, such that the labels configure e.g. domain, path, http-auth etc for the web service running in a container.
- Witoso 4y agoSame here but with caddy-docker-proxy which I found a bit easier than traefik.
- deleted 4y ago[deleted]
- Svarto 4y agoDo you know of (or used) any guide to get started? I'm reasonably proficient but struggle to put all the moving pieces together
- margorczynski 4y agoWell it was mostly pieced together information - the one that I already had from experience and the rest pulled from the Internet. But which parts do you mean exactly? How to setup nginx to act as a reverse proxy? Or putting together a docker-compose? I'm thinking of doing some kind of guide for this type of thing on my blog - basically from setting up a Hetzner VPS box to running a docker-compose'd app and exposing it on a HTTPS endpoint for your own domain (so setting up DNS probably also).
- vitro 4y agoSlightly related: https://news.ycombinator.com/item?id=34940181 https://news.ycombinator.com/item?id=34940181 https://github.com/Haxxnet/Compose-Examples https://github.com/Haxxnet/Compose-Examples
- dmje 4y agoI've been impressed with Yunohost [0]. I only have it setup on an internal box for now but it works well, and super easy to use. Good for people like me who aren't interested in admin. [0] https://yunohost.org/en https://yunohost.org/en
- Eumenes 4y agoThe only time I've seen democratize used correctly in the tech sense
- dvisca 4y agoYunohost is great! I have a small Hetzner VPS set up at Yunohost with Baikal, Nextcloud, Outline Wiki, Bitwarden (or Vaultwarden) and Wallabag. I haven't had any major problems since the initial installation about a year ago, although I happily install and uninstall software every now and then, not necessarily ensuring a stable environment.
- linsomniac 4y agoSelf-hosting is a big operations problem, with few tools to automate it. Long ago, I had an associate tell me that he was having some success with setting up Wordpress sites for local political organizations. I said to him: "Oh, that's really neat! What are you doing to ensure that the sites stay up to date with security patches?" His response was completely unrelated to my question, which I figured was my answer and was why there are so many hacked sites out there. Anything I deploy needs to have an upgrade plan. Ideally, something that provides a package (either on distro or a repo the package provides), so "apt update" will resolve it. Docker can be a good way as well, Sentry does a pretty good job at this.
- x0x0 4y agoThe entire discussion on the link obscures the fact that saas companies are providing a real service. Even if you don't want the product to be updated, staying abreast of security patches, external api changes, OS changes, client changes, browser changes, etc is real work. Self hosting requires the person hosting to do all the ktlo work.
- KronisLV 4y ago> Anything I deploy needs to have an upgrade plan. Ideally, something that provides a package (either on distro or a repo the package provides), so "apt update" will resolve it. Docker can be a good way as well, Sentry does a pretty good job at this. I wrote an article called "Never update anything": https://blog.kronis.dev/articles/never-update-anything https://blog.kronis.dev/articles/never-update-anything which in truth argued that while updates are necessary, they're also going to break things... a lot. And there isn't always going to be an upgrade path either (e.g. using AngularJS or Clusterpoint). In my experience, even containers break things surprisingly often: everything from GitLab, Nextcloud, OpenProject to even things breaking in regular server updates, like a Debian update breaking GRUB or another Debian install automatically launching exim4 which prevented my own mail server from working. Perhaps that's because of how we build and package software, because of the fact that we don't separate the runtime from the data enough (e.g. persistent directories) or that we make too many assumptions about the environments... Regardless, I can understand why some don't even update working but insecure software: because of the risk to turn it into secure but not working software.
- fabianhjr 4y agoIts better to design, implement, and use local-first software: https://www.inkandswitch.com/local-first/ https://www.inkandswitch.com/local-first/
- __MatrixMan__ 4y agoI'm developing such an app. I'm excited to get to the network connectivity part so I can see how much I've saved by making the client smart. I think I'm going to be able to get away with just running the server for 36 minutes a day (three minutes every hour). The client will know to sync data during those time windows. 1hr of latency is fine for a lot of things if the client is smart about what it caches.
- triyambakam 4y agoWhat is the app?
- __MatrixMan__ 4y agoIt's a protocol for crowd sourced annotation data. So an example app that uses it would go something like this: Suppose you have a food allergy, and you have a reaction to something in a restaurant. You want to leave a note on that menu item "contains allergen XYZ" but you don't want to write on that menu, you want to annotate all such menus. You'd take a picture, OCR happens, some algorithm thinks about line wrapping and renders it as a list of strings, and then a rolling hash identifies the "features" among those strings (any substring hashes to a 16-bit integer, the ones where the first 8 bits are off count as features). Then you "paint" the menu entry in the color "contains allergen XYZ". The features that are nearby your "brushstroke" (i.e. text highlighting) are stored in a table for that "color" which is eventually synced with other users. Later, someone else who subscribes to that "color" and has a trust relationship with the first user can scan the menu, follow the same process to find the features, which are used as indices to look up the brushstroke. Then they're able to see the annotation left by the other user as an overlay on the image they queried with: supposing they have the same allergen, they now know to avoid that item. I'm calling the whole scheme Semantic Paint and the index-friendly-feature-finder Gnize (like cognize now, recognize later). It's meant for local-ish use by small-ish communities, so the data you actually have to store on your device is pretty small and restricted to colors that you've chosen and other users you've explicitly (or transitively) trusted . And you're communicating over spans like weeks or months, so it's not a big deal if it takes a few days for one brushstroke to make it to another user's device. It's not like they notice its untimely arrival, it just goes in a feature database for later query. I also thing it might have applications in genomics/proteomics, e.g. annotate a gene.
- oaththrowaway 4y agoI self host most everything through unRAID. I spent a good amount of money getting a good server setup. The only thing I rely on the cloud for is email. I've gone through several iterations of hardware and hard drive capacity over about 7-8 years now. Hard to imagine I'll ever go back. It's not even about the monthly subscriptions, I've spent more on hardware I'm sure, plus my monthly VPN and Usenet fees. It's really an exhaustion of SaaS becoming essentially keyloggers of our entire lives. I guess self hosting is the closest we have of opting out, but even then it's not enough.
- AnthonyMouse 4y agoWhat are you spending a significant amount of money on hardware? A used PC is ~$50, assuming you don't already have one. Spinning rust is ~$10/TB: https://www.amazon.com/HGST-Ultrastar-HUH728080ALE604-3-5-Inch-Enterprise/dp/B079TL4TDJ https://www.amazon.com/HGST-Ultrastar-HUH728080ALE604-3-5-In... https://www.ebay.com/itm/125797516426 https://www.ebay.com/itm/125797516426 It can be done for less than $100, done well for less than $300.
- oaththrowaway 4y agoPart of it is that I'm running a gaming VM on it and passing through a GPU to that. Plus I have another GPU for transcoding my media to HEVC. Lots of RAM for all the containers as well. I also wrote my own container that I use for all my development so I like to keep it snappy for that. I have about 20TB of platter storage (WD Reds) + parity, and 2TB of SSD cache (an additional 2TB SSD passed into the gaming vm) It slowly adds up. I started with a Raspberry Pi and a USB hard drive as storage.
- steponlego 4y agoAs for Google Analytics - who hasn't been blocking that shit for at least a decade? Heck my uMatrix pretty much auto-blocks all telemetry.
- stonewall 4y agoI self-host literally everything (email, calendar/contacts, VOIP, XMPP, you name it) from by basement with used 1U servers from eBay and a cable internet connection. It was probably more hassle than most people would want to bother with to get it set up. But, with everything up and running, there's very little maintenance. I probably spend a few hours a month tinkering still, just because I enjoy it. I use a stack of Proxmox VMs, FreeIPA for authn/authz, and Rocky Linux for all servers and workstations. My phone runs GrapheneOS with a Wireguard VPN back to the house. I don't expose anything to the public internet unless absolutely necessary. I recently anonymized and Ansibilized my entire setup so that others might get some use out of it: https://github.com/sacredheartsc/selfhosted https://github.com/sacredheartsc/selfhosted
- triyambakam 4y agoVery inspiring and thank you for sharing. I run GrapheneOS too but I haven't set anything up like a Wireguard VPN. What is the rough idea of how that works?
- stonewall 4y agoI plug my cable modem into a server running the OPNsense firewall [0], which has a wireguard plugin. I set up a wireguard VPN in OPNsense. Then I downloaded the wireguard app in F-Droid, and pasted my credentials from the wireguard Android app into the wireguard configs on the firewall. I set the VPN in grapheneOS as "always on," so from my phone's perspective, it always has access to my internal network, even when on LTE. All my phones internet traffic ends up going through my home internet connection as a result. [0] https://opnsense.org/ https://opnsense.org/
- j45 4y agoTry installing algovpn it’s pretty much a turnkey wireguard installation, lots of tutorials on YouTube. I would advise against setting up wireguard manually.
- zwilliamson 4y agoCheckout Tailscale for an easy to rollout WireGuard based solution that has a fair free tier
- triyambakam 4y ago> which honestly kind of upset me a lot I've seen this language more and more frequently: minimized (kind of) + maximized (a lot) qualifiers. No real insight, just interesting.
- jeppester 4y agoThis is definitely a thing, and I worry that I'm guilty of it myself. I don't know if I should thank you for this insight or if you just cursed me.
- creativenolo 4y agoThis. I've seen a lot using this on its own more and more frequently too.
- scubbo 4y agoIn my idiom, at least, "kind of" is not solely deminisher, but can also be an approximater - to say something "kind of upset me" _could_ mean "it upset me, but not a great deal", or it could mean "it had an effect on me which is complicated and difficult to concisely describe, but which can be approximately described as 'upset'". In that reading, this isn't a contradiction at all - "which honestly had an extremely large effect on me which was similar to, but not entirely the same as, being upset".
- rhaway84773 4y agoI don’t think the “kind of” here is serving to minimize the “upset ness”. I think it’s describing the fact that the person wasn’t really “upset”, but some other emotion which they can’t express, which was kind of like being upset, but not exactly the same.
- bitsinthesky 4y agoNice catch. I've been using this construction and I've been oblivious to its hypocrisy until now :) I might start seeing how far I can stretch it to make it obvious how silly it is. "Which honestly did not at all upset me a ridiculous amount." Sounds unhinged.
- eointierney 4y ago
- satvikpendem 4y agoI posted about this before but I would recommend Coolify for self hosting applications, it's an open source Heroku alternative that has one-click installation of services like Plausible, NextCloud etc. It works with Herokuish buildpacks as well as Docker + Docker Compose (with Kubernetes support coming soon). I personally use a $5 Hetzner server in Northern Virginia which works great, cheaper and faster than the equivalent in DigitalOcean. https://coolify.io https://coolify.io
- jeppester 4y agoThis is a thing I'm very interested in currently. It seems like the last 10 years tech innovation (especially cloud) should have also made it much easier to run - and maintain - things on-premise. Containers, easy to setup SSL, immutable OS's, reverse proxies. Those things coupled with cheap and power efficient workstations/nucs seem like a very good match, at least in theory. Then we have the GDPR laws which - also in theory - should be much more tangible when you know exactly where your data is - and backups can still easily be stored in the cloud as long as they are encrypted. The biggest issue I see is the lack of ECC memory in the machines I mentioned. And then that this idea goes against the business model of the cloud providers, who have a great deal of control over where we are heading and what we are talking about. Still I cannot help but think there's a lot of opportunity in that area which seems rather untapped so far.
- ThinkBeat 4y agoI have tried a lot of different alternatives to Zapier and in my opinion, they are not even close in terms of productivity. I can get things running with little fuzz and it keeps working for the most part. Now that just means it works for my needs and the connections I need to make. I have stopped using Zapier because they are far too expensive for my budget. Now I make do with a few Perl scripts for what I really need and ifttt
- jojobas 4y agoHave been hosting my email/jabber/matrix from a quiet atom machine in my living room, won't have it any other way.
- bsnnkv 4y agoMy experience has been that after having become comfortable with Nix, self-hosting is the path of least resistance for the majority of "mainstream" tooling where you can pick between paying for a SaaS or self-hosting. So nice to not have to deal with Docker containers to deploy (most things) anymore. I see a lot of people suggesting hosting on a VPS, but I feel that a Hetzner Auction box is often much better bang-for-buck and serves as a nice remote dev/build box for projects that need that extra oomph when you aren't working from a capable desktop or laptop. [1]: This was the article that finally opened my eyes to the power of Nix for self-hosting https://arne.me/blog/plex-on-nixos https://arne.me/blog/plex-on-nixos, and it is such a huge upgrade from the previous Docker setup I was running[2] [2]: https://github.com/madslundt/docker-cloud-media-scripts https://github.com/madslundt/docker-cloud-media-scripts
- seqizz 4y agoOh I was looking the thread of the cult :) /s As a fellow follower, I can also recommend SNM[0] if anyone wants to self-host their e-mail. Works with zero maintenance, except upgrades which cause few lines to change. [0]: https://gitlab.com/simple-nixos-mailserver/nixos-mailserver https://gitlab.com/simple-nixos-mailserver/nixos-mailserver
- PuffinBlue 4y agoThat was a great write up on nix. Nix isn't something I know much about at all so thanks for the link. What surprised me the most was learning rclone can mount object storage locally! That's vey interesting to learn :-)
- simongray 4y agoOne of the main reasons I use Docker is being able to run the exact same Dockerfiles locally and in prod, with virtualisation taken care of automatically on e.g. Mac. Is Nix a viable alternative to that?
- ParetoOptimal 4y ago> Is Nix a viable alternative to that? Yes, it even provides stronger reproducibility guarantees that what you build locally and what's on prod are exactly the same. You can also build a docker container from the Nix expression, see: https://nix.dev/tutorials/building-and-running-docker-images https://nix.dev/tutorials/building-and-running-docker-images If you are interested, I recommend then also checking out https://zero-to-nix.com/ https://zero-to-nix.com/
- urbandw311er 4y agoI was sad not to see a mention for Sendy in the self-hosted mailing list category. Been using it for years, affordable reliable and well designed.
- zwilliamson 4y agoI love self hosting. Here’s my home setup. Hardware (you don’t need much!) Mini atx tower, 8TB usable storage, Debian, AMD processor, 8GB memory Pfsense Firewall (Tailscale exit node) Plume Wi-Fi (would like to replace, owned by comcast now) Solution stack: Portainer + Docker Compose to manage everything Nextcloud Photo Prism Tailscale (remote WireGuard based access from all my devices. Integrates well with Pfsense) Home Assistant (amazing platform for home automation and more). I love the new voice control features and mission! Used to self host Email with Helm hardware company (not k8s Helm) but they went out of business. Self hosting email is annoying thanks to the big email providers and their control over the spam filtering world. Matrix chat server bridging all the chat interfaces I use. This is managed by an awesome open source Ansible playbook https://github.com/spantaleev/matrix-docker-ansible-deploy https://github.com/spantaleev/matrix-docker-ansible-deploy Pihole
- hanklazard 4y agoThat’s a great stack, I have a similar one but also with syncthing. It’s really impossible to overstate what a game-changer tailscale has been for my setup. Especially the subnet router feature, allowing me to use all my LAN IP addresses remotely. I feel much better about self-hosting applications when I can keep all my firewall ports completely closed.
- dicknuckle 4y agoNot sure about the email specific issues you may have had, but did you run your outbound through Mailgun or Sendgrid? I've used Mailgun personally and professionally for years, just started using Sendgrid at work and love both.
- cobertos 4y agoDo you find that your Matrix integrations with other services are flaky at all? Or have trouble integrating specific features from other types of chat?
- ashayh 4y agoThe article gives a small number of self-hosted examples. Heres some more https://github.com/awesome-selfhosted/awesome-selfhosted https://github.com/awesome-selfhosted/awesome-selfhosted
- college_physics 4y agoWhy isnt this a more widespread business model? DIY is "fun" but streamlining everything for the average household would have a much bigger audience. Offer a linux distro that is customized to provide from a menu of self-hosted services (with as little pain as possible), along with a subscription for support. Could be offered as an extra service by the ISP provider or partners or entirely independent.
- dewey 4y agoBecause not a lot of people care about this being a thing, ask anyone outside of HN if they would run Linux and they most likely don't even know what it is. There's not much upside for anyone using that over free Gmail/Drive/Photos for everyone except a small group who thinks they need to own their Email and Google is evil. It's a fair standpoint, but unrealistic to anyone not deep into the topic.
- college_physics 4y agoWhat you are saying is that the opinion of the most informed about a topic does not matter because ignorance rules. The analogy is if all doctors were warning about the risks of smoking in their journals but because smokers dont read them and dont see the "upside" of quiting its not going to happen.
- deleted 4y ago[deleted]
- tiffanyh 4y agoDoes “self-host”, also include purchasing (not renting) the server you’re hosting it on and collocating it at a data center or hosting it from your house?
- dicknuckle 4y agoArguably, yes.
- doublerabbit 4y agoThe joy and thrills, heart attacks and anger with colocation; I wouldn't want it any other way. I'm proud of my 4u corner of internet space. Knowing its my data, my hardware and my internet; makes me happy. I just wish IPv6 was more of a thing.
- LelouBil 4y agoI currently self host my password manager and a CalDav and cardDav server. When I disabled contacts and calendar synchronization on my phone I couldn't feel happier ! The rest (photos, cloud storage) will hopefully follow when I have the time.
- rektide 4y agoIm fully onboard with the geneneral idea as a target. Right now it's for early early adopters. Hosting stuff is still a pain. But we are getting better at hosting stuff! Finding stable patterns, paving the path. Hint, it's not doing less, it's not simpler options: it's adopting & making our own industrial scale tooling. https://github.com/onedr0p/home-ops https://github.com/onedr0p/home-ops is a great early & still strong demonstration. The up front cost of learning is high, but there's the biggest ecosystem of support you can imagine, and once you recognize the patterns, you can get into flow states, make stuff happen, with extreme leverage far beyond where humanity has ever been. Building the empowered individual/operator is happening, and we're using stable good patterns that will mean the individual isnt so off on their own doing ops- they'll have a lot more accrued human experience at their back, their running of services isnt as simple to understand from the start but goes much much further, is much more mature & well supported in the long run. It's a major phase change for home-ops, picking tech because it's strong & good, not just easier to get started. And over time I think the on ramps & the mental models will be ever more visible, that the old cobble it together from pieces ways will fade. There's so many rejectionist principles at play. There's many realms of Back-To-The-Land mentality, rejecting modernity & swearing we're better with less, that we free ourselves. Being willing & able to accept help & better starting places will, in my view, certainly take over; there's already huge scope home-ops folks can handily take on well beyond what would have been imagineable, and the share-ability keeps growing, we keep better amplifing each other by having these shared core home cloud platforms. I love the modern growth, embrace of good cloud tech at home.
- codingninja 4y agoYou might like my homelab hypervisor project, https://github.com/ordiri/ordiri https://github.com/ordiri/ordiri It's built on-top of the Kubernetes API server runtime and deploys virtual machines and tenant networks, you can see the Kubernetes cluster I deploy using IaC YAML manifests here - https://github.com/ordiri/ordiri/tree/master/ordiri/examples/k8s https://github.com/ordiri/ordiri/tree/master/ordiri/examples... It powers all my publicly hosted, ipv6 only services - https://blog.dmann.xyz https://blog.dmann.xyz for example, it's 1000% over kill but a fun project none the less :)
- codingninja 4y agoI self host a huge amount of stuff on-top of a custom cloud platform I built using a Kubernetes cluster deployed as a tenant of my cloud. I run a few servers which all have an "ordlet" installed, akin to the kubelet, which configure network namespaces for isolated tenant networking and boots virtual machines which use a EC2 style metadata server to fetch their boot script, which for this purpose configures a HA kubernetes cluster that then uses ArgoCD to fetch all the manifests from my git repo using an AppSet. It's so incredibly over complicated and over engineered, it's a lot of fun :) https://github.com/ordiri/ordiri https://github.com/ordiri/ordiri
- wenbin 4y agoreading these comments, it’s clear that cloud based saas is and will continue to be a great business :) self hosting is a cool thing if you have the time & expertise to do it right. oftentimes things that look easy inside silicon valley / tech bubble are not so straightforward to others. reminds me of the “you can just set up ftp on linux” comment on the dropbox show hn post :)
- bernhardjamil 4y ago[dead]
- einhverfr 4y agoAt PGConf India, one of the keynotes addressed exactly this topic. The largest stock broker firm in India had made the decision to self-host everything. The CTO made a number of points that I think are missed in this discussion and article, namely: 1. You may think you are a software company, but HR, accounting etc are just as critical to your operations as the customer product. Therefore there isn't really a distinction between core business and non-core business that people like to think, and 2. By self-hosting you ensure you learn the technology and can therefore respond to problems yourself. In an environment where businesses are increasingly on the hook for defects in their services to the end user, that's a good thing. Obviously hiring knowledgeable people is probably the bottleneck but it is still a cost saver and it is important to create an organizational culture where people can learn the technology on the job.
- sgt 4y agoAgreed fully. You might risk slightly more downtime, but the overall benefit of owning it yourself is well worth it long term.
- einhverfr 4y agoOver time, if you come to understand the technology, you can fix things a managed service cannot, so you might actually risk less downtime if you prioritize that. At least that's my experience based on fighting weird bugs on managed database services.
- efields 4y agoThis is me, a principal frontend engineer and “player-coach” team lead of a few engineers in a pharmaceutical. We do as much as we can for the various digital properties, short of intense design (leaders want a willing agency they can torment).
- InnerGargoyle 4y agocan you link it?
- 4y ago
- gibs0ns 4y agoI self host a lot, including some business related infrastructure for my home office (some employees also work from here). However services designed to be accessed by a wider public audience (eg; websites, emails, Nextcloud) are hosted on a rented dedi. As other comments have pointed out, kids suck up every minute of your life, and when the internet or Plex don't work I'll know about it real quick (DAAAAD!). The important question for me is; how fast can I rebuild all of this if all the drives were wiped? Here is my home setup; Hardware: * OPNSense - old i5 desktop, 70GB hdd, 20GB RAM * TrueNAS - AMD A10-5800K, 16TB hdd, 1TB ssd, 8GB RAM * OpenNebula Frontend - Random Intel NUC, 128GB ssd, 4GB RAM * OpenNebula KVM Node - Xeon ?, 4TB hdd, 64GB RAM * OpenNebula KVM Node - Xeon Silver ?, 2TB ssd, 128GB RAM + GTX 1070Ti * Unifi EdgeSwitch ES-48 * Unifi WAP's Software: * OPNSense for routing * OpenNebula for VM's * Nomad for docker containers * NetMaker for Wireguard based VPN Main Apps: * Home Assistant VM * Plex (+rtorrent+sonarr+radarr+jackett+ombi) containers * FusionPBX container for VoIP * Kasm for remote desktops * Rundeck container for various infrastructure based automation jobs * Zabbix + Grafana containers for monitoring * PacketFence VM for NAC * Shinobi container for NVR * Snapcast container for multi-room audio I also have plenty of containers and VM's for various testing apps, or dev projects. All of my non-critical containers (eg; Plex) self update daily at early morning hours. For the critical stuff, I have tried to automate updates as much as possible. The majority of things can be recreated from ansible, docker compose, or Nomad scripts, all of which are backed up to an offsite Nextcloud instance. I use a lot of services on Opnsense, but I think one of the most important for me is the Traffic Shaper, allowing for bandwidth control. I have about 14 VLAN's, and am in the process of setting up VXLAN's for further isolation. I use restic for encrypted backups, stored in Wasabisys.com (no cost to download, unlike Backblaze). I will admit there is still one design flaw that I'm yet to spend time overcoming; if everything is powered on at the same time, there is a chance some devices won't get an IP because OpnSense is not yet ready. My current flawless work-around is to boot Opnsense 30 seconds before everything else.
- Axsuul 4y agoThanks for sharing! Why rundeck when you are already using Nomad? Also what do you use to self update your containers within Nomad?
- goplayoutside 4y agoPika Pods[1] deserves a mention here. No affiliation. Previously on HN: https://news.ycombinator.com/item?id=31284512 https://news.ycombinator.com/item?id=31284512 It's essentially "self hosting as a service". They package popular foss projects in docker containers and run them for you (on fly io, iirc) for a dollar or three per month. 1. https://www.pikapods.com/ https://www.pikapods.com/
- keybits 4y ago+1 for PikaPods - very good value, fast performance and the developer has a track record of solid service offerings such as https://www.borgbase.com/ https://www.borgbase.com/
- openpaycard 4y ago[flagged]
- fareesh 4y agoIs there a feasible way to self host a dropbox clone? It doesn't seem possible to match their pricing - I suspect they assume most folks won't use the GB/TB they pay for
- cobertos 4y agoSeafile works well as a Dropbox clone. Been using it for a couple years now without much issue. My files are replicated to my main computer and I push files from my phone to the Seafile instance over WebDAV (automatically with Autosync in Android) and download specific files through the app.
- fareesh 4y agoYeah I was more interested in cloud backups than syncing
- cobertos 4y agoFor that I had to make a custom service that periodically runs rclone. Duplicati does cloud backups, but it has a record of being a bit sus
- fareesh 4y agoIs there a server / host that provides storage at a price cheaper than Dropbox though?
- cobertos 4y agoBackblaze B2 is the same price as Dropbox for 2TB ($0.005/Gb/mo vs Dropbox $10/2TB/mo) You can also use rclone to upload to Dropbox as the backup solution. Just wrap it in a crypt target so that Dropbox doesn't actually have the ability to scan your files/lose anything in a security breach
- teekert 4y agoA quick plug for this very excellent podcast on self-hosting all the things (except maybe email ;)): [0] They always have good suggestions and point to their repos and (example) code. They explore new things and the podcast gives you an excellent idea of the quality of services. Some things I discovered through them: Paperless NGS, PhotoPrism, Tailscale, Matrix Dendrite, Hugo, Docker-compose, Traefik, NixOS) and they talk about my fav projects a lot (Nextcloud and Home Assistant), which I have been using for years now. Recently they did a nice JellyFin challenge (they were all on Plex) and I learned a lot. [0]: https://podverse.fm/podcast/nUl1ZCL76 https://podverse.fm/podcast/nUl1ZCL76
- cobertos 4y agoIs there a good self-hosted Vercel? I _love_ the workflow of Vercel, but I dread the day they change the pricing. I know of staticdeploy.io/ but it's not active