2 ms·
Pytorch can use the 'cuda' device on AMD GPUs, not talking about HIP. It works as a drop-in replacement if your ROCm API level matches your target CUDA level.
by omneity 3y ago
Pytorch can use the 'cuda' device on AMD GPUs, not talking about HIP. It works as a drop-in replacement if your ROCm API level matches your target CUDA level. (i.e matmul on fp16 won't be supported on old AMD GPUs for example)
- mikepavone 3y agoThis technically uses HIP. AFAIK, they ran the CUDA code for pytorch through HIPIFY
- omneity 3y agoFascinating, I didn't know about this. Thank you for sharing this bit!
- gymbeaux 3y agoI love this, but in practice I find things like this are yet another problem I have to work through. I have a hard enough time getting both the nvcc and nvidia-smi commands to work at the same time or two Nvidia GPUs (one internal and one external via TB3) to work on the same driver version. PopOS usually “just works”, most other distros it’s some kind of hassle, especially if the Nvidia GPU has to handle the display output too. I try to have an AMD APU as the CPU so I can have solid graphics support on Linux. Anyway, do you know if this is just for pytorch? Is performance roughly 100% of what you’d get on an “equivalent” Nvidia GPU?