4 ms·

we are running k3s on metal in production. works great actually. we use haproxy as ingress and lb.

• polskibus 6y ago
  How stable do you see it ? What's your cluster size? How long has it been running? Any tips for how to approach starting such setup?
  • sandGorgon 6y ago
    we scale up to about 100 machines. We use spot instances EXTENSIVELY. And that configuration was tricky actually. Its been a couple of months now. Works pretty ok. k3s is actually pretty simple to use now. the tricky part was to integrate with https://github.com/kubernetes/cloud-provider-aws https://github.com/kubernetes/cloud-provider-aws and https://github.com/DirectXMan12/k8s-prometheus-adapter https://github.com/DirectXMan12/k8s-prometheus-adapter The hardest part is to get it to work with spot instances. we use https://github.com/AutoSpotting/AutoSpotting https://github.com/AutoSpotting/AutoSpotting to integrate with it.
    • venkyk 6y ago
      Wow! Impressive... what are the advantages over EKS? Just cost benefits or others as well?
      • sandGorgon 6y ago
        We want to have the exact same stack running on laptops and cloud. That's the main goal. Everything else is secondary.