3 ms·
Not only have we left Kubernetes, we left Docker. Replaced with Linux servers and SSH. Have done a lot of work with k8s in the past. Not the right tool for my
by zomglings 4y ago
Not only have we left Kubernetes, we left Docker.
Replaced with Linux servers and SSH.
Have done a lot of work with k8s in the past. Not the right tool for my startup.
- louwrentius 4y agoWhy did you come to this conclusion and how are Linux servers a better fit?
- zomglings 4y agoCame to this conclusion for teams of our current size based on years of experience and experimentation (never at the expense of the business). They are a better fit because they are much easier to manage and it's much easier to debug issues when something goes wrong. We are a small team and we hope to stay that way. But our operational responsibilities are growing significantly. The extra cognitive overhead of working with technologies like kubernetes would prevent us from scaling up our effort the way that we want to. It's hard to answer your question in detail outside of a very long essay.
- k8sToGo 4y agoAre you using at least Nomad or something?
- zomglings 4y agoNope, literally SSH and bash scripts. We are fully open source (except for our security/operational code): https://github.com/bugout-dev https://github.com/bugout-dev
- cpach 4y agoInteresting! Feel free to elaborate. What does your CI/CD/deployment pipeline look like? Do you use something like Ansible, Puppet, Chef, Salt etc?
- zomglings 4y agoCI/CD pipeline is GitHub Actions which executes over SSH commands on our servers that execute deployment scripts: https://github.com/bugout-dev/spire/blob/main/deploy/deploy.bash https://github.com/bugout-dev/spire/blob/main/deploy/deploy.... We use systemd to manage services. We use Ansible to set up servers. Our infrastructure spans AWS, Google Cloud, and servers in a datacenter.
- sph 4y agoKubernetes is overkill, but one will have to pry containers from my cold, dead hands. I will not deal with installing dependencies from the OS package manager and editing /etc files any more. Linux namespaces are a brilliant idea.
- zomglings 4y agoYeah I am not hardline anti-Docker. And anti-k8s only for small teams/companies. With larger teams, I have written and maintained custom k8s operators in production. It was a great fit for the problems we had at that scale of developers. A terrible fit for the problems my current team has.