34 ms·
Interesting. Is Kubernetes ever used as the orchestrator in HPC workloads, or rather are even containers used there? Also what are some good resources to get b
by akritrime 6y ago
Interesting. Is Kubernetes ever used as the orchestrator in HPC workloads, or rather are even containers used there? Also what are some good resources to get better at kubernetes? Currently I am mostly playing with managed k8s like digital ocean's and thinking about transitioning to k3s based bare-metal solution. So, I would really like to learn what's the right way of doing this.
- JustinGarrison 6y agoThere are some HPC environments that use Kubernetes but they likely use custom schedulers optimized for batch workloads (e.g. https://github.com/volcano-sh/volcano https://github.com/volcano-sh/volcano). "containers" are often used but not always docker containers. HPC environments I've seen will often use container primitives (e.g. cgroups, namespaces). There's a lot you can learn with managed Kubernetes and it's a great place to start. You can learn a lot of the parts of Kubernetes with running through https://github.com/kelseyhightower/kubernetes-the-hard-way https://github.com/kelseyhightower/kubernetes-the-hard-way or reading https://www.amazon.com/Kubernetes-Running-Dive-Future-Infrastructure/dp/1491935677 https://www.amazon.com/Kubernetes-Running-Dive-Future-Infras... I'll email you to follow-up since tracking HN comments isn't a great way to have a conversation.