3 ms·
>There is also a version of PyTorch that uses AMD ROCm, an open-source software stack for AMD GPU programming. Crossing the CUDA moat for AMD GPUs may be as eas
by superkuh 3y ago
>There is also a version of PyTorch that uses AMD ROCm, an open-source software stack for AMD GPU programming. Crossing the CUDA moat for AMD GPUs may be as easy as using PyTorch.
Unfortunately since the AMD firmware doesn't reliably do what it's supposed to those ROCm calls often don't either. That's if your AMD card is even still supported by ROCm: the AMD RX 580 I bought in 2021 (the great GPU shortage) had it's ROCm support dropped in 2022 (4 years support total).
The only reliable interface in my experience has been via opencl.
- htrp 3y agohas opencl actually improved enough to be competitive?
- orangepurple 3y agoI thought ONNX is supposed to be the ultimate common denominator for machine learning model cross platform compatibility
- deleted 3y ago[deleted]
- zucker42 3y agoDo you mean OpenCL using Rusticl or something else? And what DL framework, if any?
- superkuh 3y agoI should clarify that I mean for human person uses. Not commercial or institutional. But, clBLAST via llama.cpp for LLM currently. Or far in the past just pure opencl for things with AMD cards.
- 65a 3y agoROCm works fine on my 2016 Vega Frontier edition, for what it's worth.