3 ms·
dstack (K8s alternative) adds support for AMD accelerators on RunPod
- deleted 2y ago[deleted]
- abusaidm 2y agoHow is this k8s alternative when the homepage is focusing about running LLM models and AI content in containers rather than being for all workloads? Maybe it’s k8s alternative for AI/LLM!
- cheptsov 2y agoHi, I’m one of the contributors to dstack! Yes, you’re absolutely right—the title is a bit off. It should be "K8S for AI Teams Only." And yes, there is a lot of focus on LLMs specifically. If you have any other feedback, please share it!
- abusaidm 2y agoI think framing it as being able to run LLMs with ease and portability across machines and hardware is an amazing sell. Most guides are very technical and detailed that it’s a barrier for many to self host.
- mdaniel 2y agoit appears you have borked all the doc links from your readme (e.g.) https://github.com/dstackai/dstack#1-define-configurations https://github.com/dstackai/dstack#1-define-configurations
- cheptsov 2y agoOops, thanks for sharing this! Gonna update it shortly.
- latchkey 2y agoWe (Hot Aisle) are looking forward to supporting dstack on our MI300x systems as well. They are doing great work.
- bj0hn5 2y agoLooking forward to trying dStack to deploy NVIDIA NIM and NeMo Microservices.
- cheptsov 2y agoThat’s on our list! We’re actually planning to expand our examples page with a lot more frameworks! Contributors are very welcome to our repo: https://github.com/dstackai/dstack/tree/master/examples/ https://github.com/dstackai/dstack/tree/master/examples/