4 ms·
> We're also working on creating a new standard for GPU orchestration, similar to Kubernetes. What about improving GPU orchestration on Kubernetes instead?
by doctorpangloss 3y ago
> We're also working on creating a new standard for GPU orchestration, similar to Kubernetes.
What about improving GPU orchestration on Kubernetes instead?
- cheptsov 3y agoTo be frank, I’m not a fan of Kubernetes as long as GPU is concerned. Kubernetes has a very large legacy. Why we think dstack can do better: 1. Lightweight-ness - that it very easy to integrate dstack with modern cloud GPU providers. 2. AI-friendly interface built-in - no need to things like KubeFlow and alike. FTR, we integrate dstack with Kubernetes too - already [1] But our native cloud integrations can be a lot more efficient. For example, when it comes to auto-scaling - this part is in work 1. https://dstack.ai/changelog/0.15.1/ https://dstack.ai/changelog/0.15.1/