5 ms·

Do they have a good CUDA alternative?

no_wizard 3y ago
Can't speak to how it compares to CUDA however they are developing ROCm[0] [0]: https://www.amd.com/en/products/software/rocm.html https://www.amd.com/en/products/software/rocm.html
- echelon 3y ago
  Next to nothing is written that targets this. Not Stable Diffusion, not RVC, not Vall-E, not Tacotron, not Tortoise, ... Maybe the LLM space is better about this, but the generative media side definitely isn't. AMD has a market share of 0% here, and nobody publishes models with AMD support.
  - coffeebeqn 3y ago
    Could there be a compiler/transpiler from CUSA to whatever AMD is pushing ?
    - puzzlingcaptcha 3y ago
      That's what https://github.com/ROCm/HIPIFY https://github.com/ROCm/HIPIFY is (as a part of ROCm)
    - zamalek 3y ago
      I think it's llama.cpp that simply #defines all cuda_ functions to rocm_ (99% name-name). Porting seems to be that trivial.
  - Symmetry 3y ago
    The things is you can actually run Stable Diffusion. And I got PyTorch working on my AMD 7900 XT graphics card recently, though it was a bit of a hassle to do so.
    - godshatter 3y ago
      You can also run Stable Diffusion in cpu mode, if you don't mind it being slower. I have an NVIDIA card but it's not powerful enough to run it. I'm on Ubuntu.
    - echelon 3y ago
      > though it was a bit of a hassle to do so. Incredible understatement. And the diverse set of community tools also breaks down. We're still a year or more out from proper AMD support in the ecosystem.
- zamalek 3y ago
  I can attest that it works really well on my 6900xt. Compiling CUDA kernels is merely a matter of a using a #define shim. Also, provided you download the ROCm pytorch (and force compatibility with the HSA_OVERRIDE_GFX_VERSION) everything just works.
dekken_ 3y ago
it's called hip, and it's mostly the same AMD have their own thrust gpu impls, so from a high level they are somewhat interchangeable
2OEH8eoCRo0 3y ago
I don't know, but couldn't people use LLMs to drastically lower the cost of switching? Converting a codebase to use a different platform doesn't require creativity.
- gumballindie 3y ago
  I think we shouldnt even try, because LLMs will simply design new hardware and software all by its own. All we need to do is sit and watch, while collecting UBI.
machinekob 3y ago
No

Can't speak to how it compares to CUDA however they are developing ROCm[0] [0]: https://www.amd.com/en/products/software/rocm.html https://www.amd.com/en/products/software/rocm.html

echelon 3y ago
Next to nothing is written that targets this. Not Stable Diffusion, not RVC, not Vall-E, not Tacotron, not Tortoise, ... Maybe the LLM space is better about this, but the generative media side definitely isn't. AMD has a market share of 0% here, and nobody publishes models with AMD support.
- coffeebeqn 3y ago
  Could there be a compiler/transpiler from CUSA to whatever AMD is pushing ?
  - puzzlingcaptcha 3y ago
    That's what https://github.com/ROCm/HIPIFY https://github.com/ROCm/HIPIFY is (as a part of ROCm)
  - zamalek 3y ago
    I think it's llama.cpp that simply #defines all cuda_ functions to rocm_ (99% name-name). Porting seems to be that trivial.
- Symmetry 3y ago
  The things is you can actually run Stable Diffusion. And I got PyTorch working on my AMD 7900 XT graphics card recently, though it was a bit of a hassle to do so.
  - godshatter 3y ago
    You can also run Stable Diffusion in cpu mode, if you don't mind it being slower. I have an NVIDIA card but it's not powerful enough to run it. I'm on Ubuntu.
  - echelon 3y ago
    > though it was a bit of a hassle to do so. Incredible understatement. And the diverse set of community tools also breaks down. We're still a year or more out from proper AMD support in the ecosystem.
zamalek 3y ago
I can attest that it works really well on my 6900xt. Compiling CUDA kernels is merely a matter of a using a #define shim. Also, provided you download the ROCm pytorch (and force compatibility with the HSA_OVERRIDE_GFX_VERSION) everything just works.

dekken_ 3y ago

it's called hip, and it's mostly the same AMD have their own thrust gpu impls, so from a high level they are somewhat interchangeable

2OEH8eoCRo0 3y ago

I don't know, but couldn't people use LLMs to drastically lower the cost of switching? Converting a codebase to use a different platform doesn't require creativity.

gumballindie 3y ago
I think we shouldnt even try, because LLMs will simply design new hardware and software all by its own. All we need to do is sit and watch, while collecting UBI.

machinekob 3y ago