3 ms·

Whenever I look at Kubernetes, I can't help myself but think that it's overcomplicated, with too many moving parts. Almost as if to incentivise using the hosted

by amq 9y ago

Whenever I look at Kubernetes, I can't help myself but think that it's overcomplicated, with too many moving parts. Almost as if to incentivise using the hosted solutions instead of rolling it on your own on some VPSs. I can deploy a HA Swarm Mode cluster anywhere in minutes, while I'm not sure even where to start with Kubernetes. Do I use juju (recommended Ubuntu way), or do I use kubeadm? Which network add-on do I use? How do I upgrade (the procedure seems to be different with each version)?

koko775 9y ago
Well...at least it's not OpenStack! Out of the couple of stacks I tried, kops was the easiest to set up. Juju and kubeadm were so-so.
plesiv 9y ago
It doesn't help that most of the open source solutions to deploy a cluster are either poorly engineered (e.g. kubespray) or poorly maintained (e.g. kubeadm). You are on to something... organizations/people that have the capability and resources to make the toolings to manage Kubernetes setup complexity seem to think they're much better off if they charge for it.
vhffm 9y ago
There's a way of setting up a bare-metal (or VMs) cluster using Ansible. It may be the sort of 'easy in' you may be looking for: https://kubernetes.io/docs/getting-started-guides/fedora/fedora_ansible_config/ https://kubernetes.io/docs/getting-started-guides/fedora/fed... If you manage to automate deployment of the VMs or physical nodes (e.g., PXE), you've got a cherry on top.
nvarsj 9y ago
If you’re not prepared to dedicate a small team to running Kubernetes, I’d say it’s too much for your needs. Read the Borg paper for an idea of what k8s is meant to solve. If you have hundreds of services spread across 10s/100s of nodes, then the complexity of k8s starts to become amortized. Similarly if you have 100s of devs without a consistent way to do deployments, k8s starts to make sense. Source: tech lead for a team managing a large on-prem and cloud k8s cluster.
sandGorgon 9y ago
+1 highly agreed. I'm actually surprised that most people dont try Docker Swarmkit. It is unbelievably good for what it does.

by amq 9y ago

koko775 9y ago

Well...at least it's not OpenStack! Out of the couple of stacks I tried, kops was the easiest to set up. Juju and kubeadm were so-so.

plesiv 9y ago

It doesn't help that most of the open source solutions to deploy a cluster are either poorly engineered (e.g. kubespray) or poorly maintained (e.g. kubeadm). You are on to something... organizations/people that have the capability and resources to make the toolings to manage Kubernetes setup complexity seem to think they're much better off if they charge for it.

vhffm 9y ago

There's a way of setting up a bare-metal (or VMs) cluster using Ansible. It may be the sort of 'easy in' you may be looking for: https://kubernetes.io/docs/getting-started-guides/fedora/fedora_ansible_config/ https://kubernetes.io/docs/getting-started-guides/fedora/fed... If you manage to automate deployment of the VMs or physical nodes (e.g., PXE), you've got a cherry on top.

nvarsj 9y ago

If you’re not prepared to dedicate a small team to running Kubernetes, I’d say it’s too much for your needs. Read the Borg paper for an idea of what k8s is meant to solve. If you have hundreds of services spread across 10s/100s of nodes, then the complexity of k8s starts to become amortized. Similarly if you have 100s of devs without a consistent way to do deployments, k8s starts to make sense. Source: tech lead for a team managing a large on-prem and cloud k8s cluster.

sandGorgon 9y ago

+1 highly agreed. I'm actually surprised that most people dont try Docker Swarmkit. It is unbelievably good for what it does.