I run a data infrastructure on terraform and kubernetes. Things it gives me out of the box: * DNS. This lets all the various components talk to each other acro

I run a data infrastructure on terraform and kubernetes. Things it gives me out of the box: * DNS. This lets all the various components talk to each other across nodes (Airflow, Spark, Zeppelin, etc.). I can also, via VPN, connect to things to look at what's going on. * Load-balancing. I create pods and then they run on the node where there's capacity without me thinking about it. * Auto-scaling. I spin up pods and nodes get created to handle the load. * Helm charts for things so I don't have to figure out how to run them myself. * Built-in support in the tools I use. Airflow will spin up k8s pods to run tasks. Spark will spin up pods to run a job. Etc.