4 ms·

The software support for AMD gpu is probably lags 10 years or so after Nvidia. They just release there sdk for windows this year (more specifically 2023-05-24,

The software support for AMD gpu is probably lags 10 years or so after Nvidia. They just release there sdk for windows this year (more specifically 2023-05-24, Rocm 5.5.1). While CUDA exists for both platform like forever. So there won't be a common user group besides some lab (which have the man power to invest in linux software and setup new tool chains) that use AMD card for AI related task. But since Rocm for windows finally released. The situation may finally change. We can probably just wait and see what will go on.

selfhoster11 3y ago
My impression was rather that CUDA is successful because it will work on any NVidia GPU that's not yet old enough to vote, which means a number of things: - people had lots of time to get used to it - hobbyists and smaller research outfits/labs could make use of it on the cheap and less powerful hardware (where even a cheap GPGPU beats computing in software), driving: - mind share (compare: Photoshop/Microsoft's tolerance to piracy) - sales of hardware when the users decided to upgrade, buying more and/or and/or more modern and/or better cards - the longer it has been available, the more stable of a programming target it appears to be, driving a virtuous cycle In contrast, the range of AMD hardware supporting ROCm was narrow and unstable (AFAIK one card was only supported for a couple of years). This would of course make ROCm unattractive for building with, especially for the hobbyists and smaller outfits that would otherwise drive mindshare but couldn't afford datacenter grade hardware that was supported.
- mmis1000 3y ago
  Recent rocm on windows also supports more cards than it used to be. Consumer rdna2/3 cards are mostly on the support list. Although these only available on windows for some reason. And the only consumer card supported on linux is still 'AMD Radeon™ VII'. No idea if AMD will drop whole list like it previously done this time though.

selfhoster11 3y ago

My impression was rather that CUDA is successful because it will work on any NVidia GPU that's not yet old enough to vote, which means a number of things: - people had lots of time to get used to it - hobbyists and smaller research outfits/labs could make use of it on the cheap and less powerful hardware (where even a cheap GPGPU beats computing in software), driving: - mind share (compare: Photoshop/Microsoft's tolerance to piracy) - sales of hardware when the users decided to upgrade, buying more and/or and/or more modern and/or better cards - the longer it has been available, the more stable of a programming target it appears to be, driving a virtuous cycle In contrast, the range of AMD hardware supporting ROCm was narrow and unstable (AFAIK one card was only supported for a couple of years). This would of course make ROCm unattractive for building with, especially for the hobbyists and smaller outfits that would otherwise drive mindshare but couldn't afford datacenter grade hardware that was supported.

mmis1000 3y ago
Recent rocm on windows also supports more cards than it used to be. Consumer rdna2/3 cards are mostly on the support list. Although these only available on windows for some reason. And the only consumer card supported on linux is still 'AMD Radeon™ VII'. No idea if AMD will drop whole list like it previously done this time though.