If you would like to put Kubernetes on top of this kind of setup this repo is helpful https://github.com/robrohan/skoupidia https://github.com/robrohan/skoupidi

If you would like to put Kubernetes on top of this kind of setup this repo is helpful https://github.com/robrohan/skoupidia https://github.com/robrohan/skoupidia The main benefit is you can shut off nodes entirely when not using them, and then when you turn them back on they just rejoin the cluster. It also helps managing different types of devices and workloads (tpu vs gpu vs cpu)