4 ms·

Somewhat off-topic, but as someone interested in k8s, why is it seemingly such a pain to set up in non-"cloud" environments? I know that Rancher exists - and I'

by notamy 9y ago

Somewhat off-topic, but as someone interested in k8s, why is it seemingly such a pain to set up in non-"cloud" environments? I know that Rancher exists - and I'm waiting for 2.0 to drop before migrating to Rancher-managed k8s - but beyond that the whole "ecosystem" of k8s seems pretty unfriendly to get started in without using AWS/GCE/Azure/etc (to the point of not being able to set up a cluster on bare metal at all!). Am I missing something here?

nameless912 9y ago
Check out Kubeadm. It's by far the best way to do k8s on Bare metal right now in terms of ease of use. If you want something highly customizable, check out kubespray, which is basically a big fat ansible playbook which will deployment k8s almost anywhere.
- notamy 9y ago
  > Check out Kubeadm. It's by far the best way to do k8s on Bare metal right now in terms of ease of use. I tried kubeadm a little while back, and the farthest I could get was just setting up the container network. The fact that it's still marked as alpha/beta in a lot of features[1] isn't reassuring. I will check out kubespray though; thanks for the recommendation! [1] https://kubernetes.io/docs/setup/independent/create-cluster-kubeadm/#kubeadm-maturity https://kubernetes.io/docs/setup/independent/create-cluster-...
kevin_nisbet 9y ago
Depending on what you're looking for, if it's just an environment to play around with, minikube is a good option: https://github.com/kubernetes/minikube https://github.com/kubernetes/minikube And as another poster stated, kubeadm is a good way to get started on a VM or local system by following this guide: https://kubernetes.io/docs/setup/independent/install-kubeadm/ https://kubernetes.io/docs/setup/independent/install-kubeadm... And last, possibly not what you're looking for but worth mentioning, there are commercial options available such as gravitational telekube which includes among other features a way to consistently install kubernetes amongst different environments and providers https://gravitational.com/telekube/ https://gravitational.com/telekube/. *Please be aware though that I'm affiliated with gravitational and work on telekube
- notamy 9y ago
  I use minikube locally for developing on, but so far I've not been able to get a production k8s cluster up. As I replied to the other poster, the last time I tried kubeadm, I was completely unable to get past setting up a cluster network, at best. This was some time ago, so I do want to spend time to try again soon, but so far my experience has been pretty negative. telekube looks pretty interesting, but sadly I don't have the money for any commercial offerings; side-projects can be a pain like that.
  - yebyen 9y ago
    I had some trouble setting up networking the first time, IMHO weave should be higher up in the suggested CNI plugins. Since I started using weave-net, I have never had to think about it again. An example of one of those really great tools that just gets out of your way and does exactly what it's supposed to do. My cluster is one node only but it was bootstrapped with kubeadm, and has served me well since 1.5.2. I've never heard of anyone having trouble with the Weave networking. I use my (production kube instance) as a Jenkins server with my own chart that is derived from the Jenkins helm chart, with kubernetes-plugin for slave scheduling.
rzzzt 9y ago
CoreOS' Tectonic looks like a good candidate for bootstrapping a bare metal cluster: https://github.com/coreos/tectonic-installer https://github.com/coreos/tectonic-installer

by notamy 9y ago

nameless912 9y ago

Check out Kubeadm. It's by far the best way to do k8s on Bare metal right now in terms of ease of use. If you want something highly customizable, check out kubespray, which is basically a big fat ansible playbook which will deployment k8s almost anywhere.

notamy 9y ago
> Check out Kubeadm. It's by far the best way to do k8s on Bare metal right now in terms of ease of use. I tried kubeadm a little while back, and the farthest I could get was just setting up the container network. The fact that it's still marked as alpha/beta in a lot of features[1] isn't reassuring. I will check out kubespray though; thanks for the recommendation! [1] https://kubernetes.io/docs/setup/independent/create-cluster-kubeadm/#kubeadm-maturity https://kubernetes.io/docs/setup/independent/create-cluster-...

kevin_nisbet 9y ago

Depending on what you're looking for, if it's just an environment to play around with, minikube is a good option: https://github.com/kubernetes/minikube https://github.com/kubernetes/minikube And as another poster stated, kubeadm is a good way to get started on a VM or local system by following this guide: https://kubernetes.io/docs/setup/independent/install-kubeadm/ https://kubernetes.io/docs/setup/independent/install-kubeadm... And last, possibly not what you're looking for but worth mentioning, there are commercial options available such as gravitational telekube which includes among other features a way to consistently install kubernetes amongst different environments and providers https://gravitational.com/telekube/ https://gravitational.com/telekube/. *Please be aware though that I'm affiliated with gravitational and work on telekube

notamy 9y ago
I use minikube locally for developing on, but so far I've not been able to get a production k8s cluster up. As I replied to the other poster, the last time I tried kubeadm, I was completely unable to get past setting up a cluster network, at best. This was some time ago, so I do want to spend time to try again soon, but so far my experience has been pretty negative. telekube looks pretty interesting, but sadly I don't have the money for any commercial offerings; side-projects can be a pain like that.
- yebyen 9y ago
  I had some trouble setting up networking the first time, IMHO weave should be higher up in the suggested CNI plugins. Since I started using weave-net, I have never had to think about it again. An example of one of those really great tools that just gets out of your way and does exactly what it's supposed to do. My cluster is one node only but it was bootstrapped with kubeadm, and has served me well since 1.5.2. I've never heard of anyone having trouble with the Weave networking. I use my (production kube instance) as a Jenkins server with my own chart that is derived from the Jenkins helm chart, with kubernetes-plugin for slave scheduling.

rzzzt 9y ago

CoreOS' Tectonic looks like a good candidate for bootstrapping a bare metal cluster: https://github.com/coreos/tectonic-installer https://github.com/coreos/tectonic-installer