10 ms·
Harbormaster: Anti-Kubernetes for your personal server
- stavros 5y agoHey everyone! I have a home server that runs some apps, and I've been installing them directly, but they kept breaking on every update. I wanted to Dockerize them, but I needed something that would manage all the containers without me having to ever log into the machine. This also worked very well for work, where we have some simple services and scripts that run constantly on a micro AWS server. It's made deployments completely automated and works really well, and now people can deploy their own services just by adding a line to a config instead of having to learn a whole complicated system or SSH in and make changes manually. I thought I'd share this with you, in case it was useful to you too.
- fenollp 5y ago> I needed something that would manage all the containers without me having to ever log into the machine. Not saying this would at all replace Harbormaster, but with DOCKER_HOST or `docker context` one can easily run docker and docker-compose commands without "ever logging in to the machine". Well, it does use SSH under the hood but this here seems more of a UX issue so there you go. Discovering the DOCKER_HOST env var (changes the daemon socket) has made my usage of docker stuff much more powerful. Think "spawn a container on the machine with bad data" à la Bryan Cantrill at Joyent.
- stavros 5y agoHmm, doesn't that connect your local Docker client to the remote Docker daemon? My goal isn't "don't SSH to the machine" specifically, but "don't have state on the machine that isn't tracked in a repo somewhere", and this seems like it would fail that requirement.
- mixedCase 5y agoHave you tried NixOS?
- stavros 5y agoI have, and it's really good, but it needs some investment in creating packages (if they don't exist) and has some annoyances (eg you can't talk to the network to preserve determinism). It felt a bit too heavy-handed for a few processes. We also used to use it at work extensively for all our production but migrated off it after various difficulties (not bugs, just things like having its own language).
- mixedCase 5y agoYou can talk to the network, either through the escape hatch or provided fetch utilities, which tend to require checksums. But you do have to keep the result deterministic. Agreed on it being a bit too heavy-handed, and the tooling isn't very helpful for dealing with it unless you're neck-deep into the ecosystem already.
- inetknght 5y agoWhat do you think isn't getting tracked? You could put your SSH server configuration in a repo. You could put your SSH authorization key in a repo. You could even put your private key in a repo if you really wanted.
- stavros 5y agoHow do you track what's supposed to run and what's not, for example? Or the environment variables, or anything else you can set through the cli.
- electroly 5y agoDocker Compose is designed for this.
- stavros 5y agoYep, that's why Harbormaster uses it.
- hckr1292 5y agoThe killer feature of harbormaster is watching the remote repository. Can docker-compose do that? If it can, I should just leverage that feature instead of harbormaster! The nicety here on harbormaster seems to be that there are some ways to use the same code as a template in which specific differences are dynamically inserted by harbormaster. I'm not aware of how you could use docker-compose (without swarm) to accomplish this, unless you start doing a lot of bash stuff. I also appreciate that harbormaster offers opinions on secrets management.
- gibs0ns 5y agoFor me, I don't define any variables via the cli, i put them all in the docker-compose.yml or accompanying .env file, that way it's a simple `docker-compose up` to deploy. Then I can track these files via git, and deploy to remote docker hosts using docker-machine, which effectively sets the DOCKER_HOST env var. While I haven't used it personally, there is [0] Watchtower which aims to automate updating docker containers. [0] https://github.com/containrrr/watchtower https://github.com/containrrr/watchtower
- nanis 5y ago> "don't have state on the machine that isn't tracked in a repo somewhere" https://docs.chef.io/chef_solo/ https://docs.chef.io/chef_solo/
- revscat 5y ago> chef-solo is a command that executes Chef Infra Client in a way that does not require the Chef Infra Server in order to converge cookbooks. I have never used Chef. This is babble to me.
- nanis 5y ago> Chef Infra is a powerful automation platform that transforms infrastructure into code. Whether you’re operating in the cloud, on-premises, or in a hybrid environment, Chef Infra automates how infrastructure is configured, deployed, and managed across your network, no matter its size. In an imprecise nutshell: You specify what needs to exist on the target system using Chef's DSL and Chef client will converge the state of the target to the desired one.
- redis_mlc 5y agoNormally the chef server listener is on a remote machine. But there's another way to run the chef server locally, called chef solo, which developers commonly use when writing cookbooks and recipes. Chef is one of the most complicated devops tools ever, so don't expect to understand it without effort.
- tremon 5y agochef-solo is a command that applies configuration statements on a host without using a separate metadata server.
- geofft 5y agoChef is a configuration management system. It lets you define lists of things to do called "cookbooks" (analogous to Ansible "playbooks" etc.). To "converge" is to run something until it is stable. This terminology, I think, comes from the early configuration managemnt system CFEngine, where you write your configuration in declarative(-ish) "make it so this is true" steps, instead of imperative "perform this change" steps the way that a shell script would do. See e.g. https://www.usenix.org/legacy/publications/library/proceedings/lisa2000/full_papers/burgess/burgess_html/index.html https://www.usenix.org/legacy/publications/library/proceedin... chef-solo is a command that executes Chef's client - the thing that actually makes configuration changes, that is to say, "converges cookbooks" - in a way that does not require a server component. The normal way of deploying Chef is that a server runs things on clients, the machines being configured, but chef-solo is appropriate for the case where there is no such distinction and there's just one machine where you wish to run Chef.
- thor_molecules 5y agoWhat is the "Bryan Cantrill at Joyent" you're referring to?
- zdragnar 5y agoThe technology analogy is Manta, which Bryan covers in at least one if not several popular talks on YouTube, in particular about contanerization. He has a lot to say about zones and jails and chroot predating docker, and why docker and co. "won" so to speak.
- e12e 5y agoNot (I think) the exacttalk/blog post gp was thinking of - but worth watching IMNHO: "Debugging Under Fire: Keep your Head when Systems have Lost their Mind • Bryan Cantrill • GOTO 2017" https://youtu.be/30jNsCVLpAE https://youtu.be/30jNsCVLpAE Ed: oh, here we go I think? > Running Aground: Debugging Docker in Production Bryan Cantrill19,102 views16 Jan 2018 Talk originally given at DockerCon '15, which (despite being a popular presentation and still broadly current) Docker Inc. has elected to delist. https://www.youtube.com/watch?v=AdMqCUhvRz8 https://www.youtube.com/watch?v=AdMqCUhvRz8
- thor_molecules 5y agoawesome, thanks!
- dutchmartin 5y agoInteresting case. But did you look at other systems before this? I myself use caprover[1] for a small server deployment. 1: https://caprover.com/ https://caprover.com/
- stavros 5y agoI have used Dokku, Kubernetes, a bit of Nomad, some Dokku-alikes, etc, but none of them did things exactly like I wanted (the single configuration file per server was a big requirement, as I want to know exactly what's running on a server).
- c17r 5y agoI use caprover on my DO instance and it works great. Web apps, twitter/reddit bots, even ZNC.
- reddec 5y agoLooks nice. I did something similar not so much time ago https://github.com/reddec/git-pipe https://github.com/reddec/git-pipe
- uniqueuid 5y agoWow this has a lot of great features baked in. Especially the backup and Let's encrypt elements are great. And it handles docker networks, which makes it very flexible. Will definitely check it out.
- rcarmo 5y agoThis looks great. But if you don’t need containers or are using tiny hardware, consider trying out Piku: https://github.com/piku https://github.com/piku (You can use docker-compose with it as well, but as a deployment step — I might bake in something nicer if there is enough interest)
- uniqueuid 5y ago+1 for pikku which is one of my favorite examples of "right abstraction, simple, just works, doesn't re-invent the architecture every 6 months". Thanks for that, Rui!
- rcarmo 5y agoWell, I am thinking of reinveinting around 12 lines of it to add explicit Docker/Compose support, but it’s been a year or so since any major changes other than minor tweaks :) It has also been deployed on all top 5 cloud providers via could-init (and I’m going back to AWS plain non-Ubuntu AMIs whenever I can figure out the right packages).
- stavros 5y agoThat looks nice, isn't it kind of like Dokku? It's a nice option but not a very good fit if you don't need ingress/aren't running web services (most of my services were daemons that connect to MQTT).
- rcarmo 5y agoYou can have services without any kind of ingress. It’s completely optional to use nginx, it just gets set up automatically if you want to expose a website. My original use case was _exactly_ that (MQTT services).
- stavros 5y agoOh huh, that's interesting, thanks! Is it geared towards worker/DB too, like Dokku? Unfortunately with Dokku it's a bit hard to run multiple containers together (I remember having to hack stuff to enable app deployments where one app was the frontend and another was the API).
- uniqueuid 5y agoThis looks awesome! What I couldn't immediately see from skimming the repo is: How hard would it be to use a docker-based automatic https proxy such as this [1] with all projects? I've had a handfull of docker-based services running for many years and love the convenience. What I'm doing now is simply wrap the images in a bash script that stops the containers, snapshots the ZFS volume, pulls newer versions and re-launches everything. That's then run via cron once a day. Zero issues across at least five years. [1] https://github.com/SteveLTN/https-portal https://github.com/SteveLTN/https-portal
- stavros 5y agoUnder the hood, all Harbormaster does is run `docker-compose up` on a bunch of directories. I'm not familiar with the HTTPS proxy, but it looks like you could just add it to the config and it'd auto-deploy and run. Sounds like a very good ingress solution, I'll try it for myself too, thanks! I use Caddy now but configuration is a bit too manual.
- uniqueuid 5y agoThanks! One thing to note is that you'll need to make sure that all the compose bundles are on the same network. I.e. add this to all of them: networks: default: external: name: nginx-proxy
- stavros 5y agoAh yep, thanks! One thing that's possible (and I'd like to do) with Harbormaster is add configuration to the upstream apps themselves, so to deploy, say, Plex, all you need to do is add the Plex repo URL to your config (and add a few env vars) and that's it! I already added a config for Plex in the Harbormaster repo, but obviously it's better if the upstream app itself has it: https://gitlab.com/stavros/harbormaster/-/blob/master/apps/plex-bridge.yml https://gitlab.com/stavros/harbormaster/-/blob/master/apps/p...
- 3np 5y agoFWIW Traefik is pretty easy to get running and configured based on container tags, which you cam set in compose files. Traefik can be a bit hairy in some ways, but for anything you'd run Harbormaster for it should be a good fit. Right now I have some Frankenstein situation with all of Traefik, Nginx, HAProxy, Envoy (though this is inherited from Consul Connect) at different points... I keep thinking about replacing Traefik with Envoy, but the docs and complexity are a bit daunting.
- pdimitar 5y agoThis looks super, I'll try it on my NAS.
- adamddev1 5y agoI guess I'm one of those people mentioned on the rationle who keeps little servers ($5-10 Droplets) and runs a few apps on them. (Like a couple of Node/Go apps, a CouchDB, a Verdaccio server). I also haven't had issues with things breaking as I do OS updates. Seems like it would be nice though just to have a collection of dockerfiles that could be used to deploy a new server automatically. My current "old fashioned" way has been very doable to me but my big question before jumping to some Docker-based setup is, does running everything on Docker take a huge hit on the performance/memory/capabilities of the machine? Like could I still comfortably run 4-5 apps on a $5 Droplet? Assuming I would have seperate containers for each app? I'm having trouble finding info about this.
- stavros 5y agoI haven't noticed any performance degradation (though granted, these are small apps), and my home server is 10 years old (and was slow even then).
- jrockway 5y ago"Docker containers" are Linux processes with maybe a filesystem, cpu/memory limits, and a special network; applied through cgroups. You can do all of those things without Docker, and there is really not much overhead. systemd has "slice units" that are implemented very similarly to Docker containers, and it's basically the default on every Linux system from the last few years. It's underdocumented but you can read a little about it here: https://opensource.com/article/20/10/cgroups https://opensource.com/article/20/10/cgroups
- adamddev1 5y agoCool stuff with the "slice units." I use systemd to keep apps running but didn't know all this. And yes I understand the basics of what Docker containers are. It just seems logical to me that it would be a lot more taxing on the system running that overhead. Like is it exponentially harder to fit the same amount of apps on a droplet if they're all containerized? Or is it still easy to run 4-5 modest containerized apps on a $5 droplet?
- 5y ago
- mafro 5y agoSo far I've found that "restart: always" in the compose.yml is enough for my home server apps. In the rare case that one of the services is down, I can SSH in and have a quick look - after all it's one of my home servers, not a production pod on GKE :p That said, the project looks pretty good! I'll have a tinker and maybe I'll be converted
- stavros 5y agoAgreed about restarting, but I hated two things: Having to SSH in to make changes, and having a bunch of state in unknowable places that made it extremely hard to change anything or migrate to another machine if something happened. With Harbormaster, I just copy one YAML file and the `data/` directory and I'm done. It's extremely convenient.
- uniqueuid 5y agoJust to add: It's definitely a bad practice to never update your images, because the docker images and their base images will accumulate security holes. There aren't many solutions around for automatically pulling and running new images.
- scandinavian 5y ago>There aren't many solutions around for automatically pulling and running new images. Isn't that exactly what watchtower does? https://github.com/containrrr/watchtower https://github.com/containrrr/watchtower It works great on my mediacenter server running deluge, plex, sonarr, radarr, jackett and OpenVPN in docker.
- stavros 5y agoWatchtower runs the images if they update, but AFAIK it doesn't pull if the base image changes. Then again, Harbormaster doesn't do that either unless the upstream git repo changes.
- uniqueuid 5y agoWell, yes. Curiously enough, (IIRC) watchtower started out automatically pulling new images when available. Then the maintainers found that approach to be worse than proper orchestration and disabled the pulling. Perhaps it's different now.
- nonameiguess 5y agoBeware that harbormaster is also the name of a program for adding RBAC to docker: https://github.com/kassisol/hbm https://github.com/kassisol/hbm It's kind of abandonware because it was the developer's PhD project and he graduated, but it is rather unfortunately widely used in one of the largest GEOINT programs in the US government right now because it was the only thing that offered this capability 5 years ago. Raytheon developers have been begging to fork it for a long time so they can update and make bug fixes, but Raytheon legal won't let them fork a GPL-licensed project.
- stavros 5y agoYeah, there were a few projects named that :/ I figured none of them were too popular, so I just went ahead with the name.
- ThaJay 5y agoOne of them should fork it on their personal account and work on it during bussiness hours. No liability and all the benefits. Don't tell legal obviously. "Someone forked it so now our fixes can get merged! :D"
- nonameiguess 5y agoI've honestly considered this since leaving. Why not do my old coworkers a solid and fix something for them, but then I consider I'd be doing free labor for a company not willing to let its own workers contribute to a project if they can't monopolize the returns from it.
- vonmoltke 5y ago> I consider I'd be doing free labor for a company not willing to let its own workers contribute to a project if they can't monopolize the returns from it I don't think that is the reason. When Raytheon or other contractors perform software work under a DOD contract (i.e., they charge the labor to a contract) the government generally gets certain exclusive rights to the software created. Raytheon is technically still the copyright holder, but effectively is required to grant the US government an irrevocable license to do whatever they want with the source in support of government missions if the code is delivered to the government. Depending on the contract, such code may also fall under blanket non-disclosure agreements. I believe both of these are incompatible with the GPL, and the latter with having a public fork at all. The company could work this out with the government, but it would be an expensive and time-consuming process because government program offices are slow, bureaucratic, and hate dealing with small exceptions on large contracts. They might even still refuse to make the contract mods required at the end simply because they don't understand it or they are too risk averse. Legal is likely of the opinion that it isn't worth trying, and the Raytheon program office likely won't push them unless they can show a significant benefit for the company.
- hardwaresofton 5y agoOther uncomplicated pieces of software that manage dockerized workloads: - https://dokku.com https://dokku.com - https://caprover.com https://caprover.com
- conradfr 5y agoI use CapRover and it mostly works. My biggest complaint would be the downtime when the docker script runs after each deployment.
- stavros 5y agoI use Dokku and love it! The use case is a bit different, as it's mostly about running web apps (it does ingress as well and is rather opinionated about the setup of its containers), but Harbormaster is just a thin management layer over Compose.
- wilsonfiifi 5y agoI really wish Dokku would embrace docker swarm like caprover. Currently they have a scheduler for kubernetes but the docker swarm scheduler is indefinitely delayed [0]. It’s like the missing piece to making Dokku a real power tool for small teams. Currently, if you want to scale Dokku horizontally and aren’t ready to take the kubernetes plunge, you have to put a load balancer in front of your multiple VMs running Dokku and that comes with it’s own headaches. [0] https://github.com/dokku/dokku/projects/1#card-59170273 https://github.com/dokku/dokku/projects/1#card-59170273
- proxysna 5y agoyou should give nomad a try. Dokku has a nomad backend. https://github.com/dokku/dokku-scheduler-nomad https://github.com/dokku/dokku-scheduler-nomad.
- mradmin 5y agoMy anti-kubernetes setup for small single servers is docker swarm, portainer & traefik. It's a setup that works well on low powered machines, gives you TLS (letsencrypt) and traefik takes care of the complicated network routing. I created a shell script to easily set this up: https://github.com/badsyntax/docker-box https://github.com/badsyntax/docker-box
- GordonS 5y agoThis is exactly how I deployed my last few projects, and it works great! The only things I'd change are switching to Caddy instead of Traefik (because Traefik 2.x config is just so bewilderingly complex!), and I'm not convinced Portainer is really adding any value. Appreciate you sharing your setup script too.
- dneri 5y agoAbsolutely agree, I switched to Caddy recently and the configuration is considerably easier than Traefik. Very simple TLS setup (including self signed certificates).
- e12e 5y agoAfter some struggle I've managed to set up traefik with tags/docker socket so that services can "expose themselves" via tags in their service definitions - is there anything similar for caddy?
- mradmin 5y agoAgree the traefik config is a little complex but otherwise it works great for me. About using portainer, it's useful for showing a holistic view of your containers and stacks, but I also use it for remote deployment of services (Eg as part of CI/CD). I'll push a new docker image version then I'll use the portainer webhooks to redeploy the service, then docker swarm takes over.
- GordonS 5y ago
- selfhoster11 5y agoI have a similar DIY solution with an Ansible playbook that automatically installs or restarts docker-compose files. I am considering switching to Harbormaster, since it's much closer to what I wanted from the start.
- debarshri 5y agoI have been knee deep in deployment space for post 4 years. It is pretty hard problem to solve to the n-th level. Here's my 2 cents. Single machine deployments are generally easy, you can do it DIY. The complexity arises the moment you have another machine in the setup, scheduling workloading, networking, setup to name a few, starts becoming complicated. From my perspective, kubernetes was designed for multiple team, working on multiple services and jobs, making operation kind of self serviced. So I can understand the anti-kubernetes sentiment. There is gap in the market between VM oriented simple deployments and kubernetes based setup.
- imachine1980_ 5y agoi ask if you know nomad (i didn't use it) but co-workers say was easier to deploy
- debarshri 5y agoYes, I did look into Nomad. Again, specification of application to deploy is much simpler than kubernetes. But I think operational point of view you still have the complexity. It has similar concepts and abstractions like kubernetes when you operate a nomad cluster.
- zie 5y agoFor a single machine, you don't need to operate a nomad cluster: `nomad agent -dev` instantly gives you a 1-node cluster ready to go. if you decide to grow past 1 node, it's a little more complex, but not by a lot, like k8s.
- willvarfar 5y agoJuju perhaps?
- debarshri 5y agoAre you talking about this[1]? [1] https://juju.is/ https://juju.is/
- zeckalpha 5y agoIf it can pull from git, why not have the YAML in a git repo, too?
- stavros 5y agoThat is, in fact, the recommended way to deploy it! If you look at the systemd service/timer files, that's what it does, except Harbormaster itself isn't aware of the repo. I kind of punted on the decision of how to run the top layer (ie have Harbormaster be a daemon that auto-pulls its config), but it's very simple to add a cronjob to `git pull; harbormaster` (and is more composable) so I didn't do any more work in that direction.
- aae42 5y agothis is nice, this should help a lot of people in that in-between space i just recently decided to graduate from just `docker-compose up` running inside tmux to a more fully fledged system myself... since i know Chef quite well i just decided to use Chef in local mode with the docker community cookbook i also get the nice tooling around testing changes to the infrastructure in test kitchen if this would have existed before i made that switch, i may have considered it, nice work!
- tkubacki 5y agoMy simple solution for smaller projects is to ssh with port forward to docker registry - here I wrote blog post on that topic: https://wickedmoocode.blogspot.com/2020/09/simple-way-to-deploy-docker-app-on.html https://wickedmoocode.blogspot.com/2020/09/simple-way-to-dep...
- 3np 5y agoFor users who are fine with the single-host scope, this looks great. Definitely easier than working with systemd+$CI, if you don't need it (and for all the flame it gets, systemd is very powerful if you just spend the time to get into it, but then again if you don't need it you don't) I could also see this being great for a personal lab/playground server. Or for learning/workshops/hackathons. Super easy to get people running from 0. If I ever run a class or workshop that has some server-side aspect to it, I'll keep this in mind for sure.
- sandGorgon 5y agoyou should check k3s or k0s - single machine kubernetes
- stavros 5y agoI did, but even that was a bit too much when I don't really need to be K8s-compatible. Harbormaster doesn't run any extra daemons at all, so that was a better fit for what I wanted to do (I also want to run stuff on Raspberry Pis and other computers with low resources).
- sandGorgon 5y agofair point. I have generally had a very cool experience running these single daemon kubernetes distros.
- stavros 5y agoThey look very very interesting for development and things like that, and I'm going to set one up locally to play with, they just seemed like overkill for running a bunch of Python scripts, Plex, etc.
- teyc 5y agoI find k3s still consume 5% of my little CPU constantly, and later learnt it was because Kubernetes polls processes in the background.
- gentleman11 5y agoHow am I supposed to know whether to jump on the kubernetes bandwagon when all these alternatives keep popping up? Kidding/not kidding
- debarshri 5y agoDepends upon which job interview you are going to. If is a startup, use some buzzwords like cloud native, devops etc. Check their sentiments towards kubernetes. On a serious note, You might have to jump on the kubernetes bandwagon whether you like it or not as many of the companies are serious investing their resources. Having spoken to various companies from series A to Enterprise. I do see the kubernetes adoption is actually not as much as I would have imagined based on the hype. P.S discussion of kubernetes or not kubernetes was recently accelerated by a post from Ably [1] [1] https://ably.com/blog/no-we-dont-use-kubernetes https://ably.com/blog/no-we-dont-use-kubernetes
- p_l 5y agoWhat's missing km the conversation is that said blog post can be summarised as "we have money to burn".
- proxysna 5y agoThis is not an alternative, just a small personal project. Learn docker, basics of kubernetes and maybe nomad.
- mnahkies 5y agoInterestingly this seems like a pretty popular problem to solve. I made a similar thing recently as well, although with the goal to handle ingress and monitoring out the box as well, whilst still able to run comfortably on a small box. I took a fairly similar approach, leveraging docker-compose files, and using a single data directory for ease of backup (although it's on my to-do list to split out conf/data). If there was a way to get a truly slim and easy to setup k8s compatible environment I'd probably prefer that, but I couldn't find anything that wouldn't eat most of my small servers ram https://github.com/mnahkies/shoe-string-server https://github.com/mnahkies/shoe-string-server if you're interested
- debarshri 5y agoIt is quite slim and easy to setup k8s environment, thanks to microk8s and k3s. Microk8s comes with newer version of ubuntu. k3s is a single binary installation.
- mnahkies 5y agoLast I checked k3s required a min of 512mb of ram, 1gb recommended. Is this not the case?
- debarshri 5y agoYes it is. Docker's minimum requirement is 512mb with 2gb recommended. Containerd + k8s is almost the same requirements.
- mnahkies 5y agoInteresting, I wasn't actually aware of that. Checking my running server with 1024mb of RAM, docker appears to be consuming ~50mb of that. This is running 17 containers of nginx, postgres, nodejs, haproxy etc. I'm ok with this level of overhead for the benefits of containerization - several years ago I was running a bunch of PHP sites on Apache, one was compromised and this took down the rest as well. In addition to the isolation it also simplifies my deployment story significantly. If K3s has a similar level of overhead then I should probably move to this, something for me to look into, however my understanding was that components like etcd require a fairly significant amount of resource even for tiny one node "clusters".
- dneri 5y agoThis seems like a neat project! I run a homelab and my container host runs Portainer & Caddy which is a really clean and simple docker-compose deployment stack. This tools seems like it does less than Portainer, so I am not clear on why it would be preferable - just because it is even simpler?
- GekkePrutser 5y agoCool name. Reminds me of dockmaster which was some ancient NSA system (It was mentioned in Clifford Stoll's excellent book "The Cuckoo's Egg"). It was the one the German KGB hacker he caught was trying to get into. It sounds like a good option too, I don't want all the complexity of Kubernetes at home. If I worked for the cloud team in work I might use it at home but I don't.
- nixgeek 5y agoAny chance this will get packaged up as a container instead of “pipx install”, then all the timers can just be in the container, and it can control via Docker socket exposed to the container? Simple one-time setup and then everything is a container? If that interesting to OP then I might look into that one weekend soon.
- stavros 5y agoOh yeah, that's very interesting! That would be great, I forgot that you can expose the socket to the container. I'd definitely be interested in that, thanks!
- jlkuester7 5y ago+1 for this! One of the things that I like most about my Docker setup is that I am basically agnostic to the setup of the host machine.
- sgentle 5y agoI unironically solved this problem by running docker-compose in Docker. You can build an image that's just the official docker/compose image with your docker-compose.yml on top, mount /var/run/docker.sock into it, and then when you start the docker-compose container, it starts all your dependencies. If you run Watchtower as well, everything auto-updates. Instead of deploying changes as git commits, you deploy them as container image updates. I'm not going to call it a good solution, exactly, but it meant I could just use one kind of thing to solve my problem, which is a real treat if you've spent much time in the dockerverse.
- corndoge 5y agoIs there software like Compose in terms of simplicity, that supports multiple nodes? I use k8s for an application that really needs to use multiple physical nodes to run containerized jobs but k8s feels like overkill for the task and I spend more time fixing k8s fuckups than working on the application. Is there anything in between compose and k8s?
- devmor 5y agoIf this ever gets expanded to handle clustering, it'd be perfect for me. I use k8s on my homelab across multiple raspberry pis.
- nijave 5y agoAt a previous place I worked, someone setup something similar with `git pull && ansible-playbook` on a cron It was using GitHub so just needed a read-only key and could be bootstrapped by connecting to the server directly and running the playbook once In addition, it didn't need any special privileges or permissions. The playbook setup remote logging (shipping to CloudWatch Logs since we used AWS heavily) along with some basic metrics so the whole thing could be monitored. Plus, you can get a cron email as basic monitoring to know if it failed Imo it was a pretty clever way to do continuous deploy/updates without complicated orchestrators, management servers, etc
- earthboundkid 5y agoPython is sort of a non-starter for me. If I had a reliable way of running Python on a VPS, I wouldn't need Docker, now would I?
- franga2000 5y agoWhat do you mean? Python comes pre-installed with every distro I know, virtual environment support is built in, alternative version packages are readily available on distros (but backwards compatibility is pretty good in Python anyways). If anything, Python in Docker is more of a pain than bare-metal since the distro (usually alpine or debian) ships its own Python version and packages that are almost entirely disconnected from the one the image provides.
- earthboundkid 5y agoDocker basically only exists as a popular product because of how terrible Python installation is, but okay good luck with that.
- awinter-py 5y agoso useful. I have the same use case as the author also kind of want RDS for my machine -- backup/restore + upgrade for databases hosted locally
- thiht 5y agoDo people actually us k8s on a personal server? What’s the point? Surely just Docker with restart policies (and probably even just systemd services if it’s your thing) is enough? K8s seems way overused in spheres without a real need for it. That would explain the « k8s is over complicated » I keep reading everywhere. It’s not over complicated, you just don’t need it.
- pmlnr 5y agoanti-Kubernetes is rpm/yum/apt/dpkg/pkg and all the other oldschool package managers.
- zmmmmm 5y agoCurious how things like database migrations are handled in setups like this? Is the expectation that schema updates are built into startup processes of services and happen automatically? Or is it outside the scope?
- stavros 5y agoThat's outside the scope, yes. Anything below a `docker-compose up` is for your code to handle as you like.
- KETpXDDzR 5y agoI think that's the same idea as Ubuntu's snaps. A different implemention, of course. However, snaps are conceptual more secure. However there's rootless Docker now. inb4: Flatpak is not as powerful as snap. E.g., you can't use a different level with Flatpack.