2 ms·
Is using CUDA inside a container still a massive PITA?
by jcadam 5y ago
Is using CUDA inside a container still a massive PITA?
- bogomipz 5y agoCan you elaborate on what makes containerized CUDA so difficult?
- Melatonic 5y agoI would guess the fact that its a highly proprietary design that is designed to specifically scale to massive amounts of parallel threads on specific physical hardware devices
- nancarrow 5y agothe CUDA library versions are very coupled to the hosts' CUDA driver versions and the container system itself (Docker) needs special code to link the two
- bogomipz 5y agoCan't you just do a host mount/bind mount of those specific libs though?
- jcadam 5y agoMy last project where we needed CUDA, we ended running our GPU workloads directly on a dedicated machine loaded up with GPUs. The rest of the system was containerized. Though, we were just a small team of software engineers working on an R&D project - we didn't have any k8s wizards on our team.