3 ms·

I don't think you will need something coda-compatible. Apple has relatively solid pytorch support without copying CUDA, but PyTorch+ROCm is still not working on

I don't think you will need something coda-compatible. Apple has relatively solid pytorch support without copying CUDA, but PyTorch+ROCm is still not working on windows (and I think there's no ROCm support for the consumer GPUs from AMD). I think Apple proves that it is possible, and possible relatively quickly.

kimixa 3y ago
Pytorch supports directML on windows - is that not sufficient (or performant) for your usecase? It feels like AMD are less willing to step on Microsoft's toes, possibly as they just don't have the market share clout. And Rocm supports the higher RDNA2 and the highest-end RDNA3 consumer GPUS - [0], though only the top RNDA3 cards in linux [1] (officially - other cards often do "work" but YMMV) One thing Nvidia are much better at is supporting the whole stack - while I doubt many people are actually running much ML on 8gb mid-low end cards, it seems a hook for sales if people "could" do that, and a starting point for personal experimentation. I know multiple people who buy low end Nvidia GPUs because they "might" experiment with CUDA some time in the future. [0] https://rocm.docs.amd.com/en/latest/release/windows_support.html https://rocm.docs.amd.com/en/latest/release/windows_support.... [1] https://rocm.docs.amd.com/en/latest/release/gpu_os_support.html https://rocm.docs.amd.com/en/latest/release/gpu_os_support.h...
- LeanderK 3y ago
  > One thing Nvidia are much better at is supporting the whole stack - while I doubt many people are actually running much ML on 8gb mid-low end cards, it seems a hook for sales if people "could" do that, and a starting point for personal experimentation. I know multiple people who buy low end Nvidia GPUs because they "might" experiment with CUDA some time in the future. but this is very important. Many develop locally before sending it to a cluster, especially if you only have limited credits available.

kimixa 3y ago

Pytorch supports directML on windows - is that not sufficient (or performant) for your usecase? It feels like AMD are less willing to step on Microsoft's toes, possibly as they just don't have the market share clout. And Rocm supports the higher RDNA2 and the highest-end RDNA3 consumer GPUS - [0], though only the top RNDA3 cards in linux [1] (officially - other cards often do "work" but YMMV) One thing Nvidia are much better at is supporting the whole stack - while I doubt many people are actually running much ML on 8gb mid-low end cards, it seems a hook for sales if people "could" do that, and a starting point for personal experimentation. I know multiple people who buy low end Nvidia GPUs because they "might" experiment with CUDA some time in the future. [0] https://rocm.docs.amd.com/en/latest/release/windows_support.html https://rocm.docs.amd.com/en/latest/release/windows_support.... [1] https://rocm.docs.amd.com/en/latest/release/gpu_os_support.html https://rocm.docs.amd.com/en/latest/release/gpu_os_support.h...

LeanderK 3y ago
> One thing Nvidia are much better at is supporting the whole stack - while I doubt many people are actually running much ML on 8gb mid-low end cards, it seems a hook for sales if people "could" do that, and a starting point for personal experimentation. I know multiple people who buy low end Nvidia GPUs because they "might" experiment with CUDA some time in the future. but this is very important. Many develop locally before sending it to a cluster, especially if you only have limited credits available.