4 ms·

This is totally not my field so it may very well be the stupidest question ever: is there technically anything that prevents implementing CUDA on top of non-NVI

by lloeki 9y ago

This is totally not my field so it may very well be the stupidest question ever: is there technically anything that prevents implementing CUDA on top of non-NVIDIA hardware?

FnuGk 9y ago
CUDA is made by nvidia
- baldfat 9y ago
  Not sure why you were down voted. CUDA is developed by NVIDIA. CUDA is a registered trademark by NVIDIA - https://trademarks.justia.com/850/30/cuda-85030071.html https://trademarks.justia.com/850/30/cuda-85030071.html Here is the CUDA webpage https://developer.nvidia.com/cuda-zone https://developer.nvidia.com/cuda-zone
  - iforgotpassword 9y ago
    Because it's a pointless answer that basically just repeats part of the question, providing absolutely no new information.
    - baldfat 9y ago
      Well I think it makes a short answer NVIDIA doesn't let their proprietary CUDA technology work on non-NVIDIA devices.
orbifold 9y ago
No there isn't, Google developed a CUDA frontend for clang/llvm which targets PTX (nvidias virtual machine instruction set), in principle someone could come along and implement a different backend for this frontend targeting for example AMDs gpu instruction architecture or something different. The other ingredient missing is a reimplementation of CUDAs runtime libraries.
- cjalmeida 9y ago
  The last part is particularly important. Most deep learning libs rely on things like cuDNN which implement by hand basic operations very efficiently. The ROCm initiative by AMD already "transpile" most CUDA kernels to being AMD compatible, but it seems performance is not yet comparable in real word benchmarks.
bryanlarsen 9y ago
AMD is working on a tool to convert CUDA code: https://github.com/ROCm-Developer-Tools/HIP https://github.com/ROCm-Developer-Tools/HIP
rodburns 9y ago
We are working on an OpenCL based layer that enables AMD GPUs, see these links for more info https://developer.codeplay.com/computecppce/latest/getting-started-with-tensorflow https://developer.codeplay.com/computecppce/latest/getting-s... https://github.com/tensorflow/tensorflow/issues/22 https://github.com/tensorflow/tensorflow/issues/22

by lloeki 9y ago

This is totally not my field so it may very well be the stupidest question ever: is there technically anything that prevents implementing CUDA on top of non-NVIDIA hardware?

FnuGk 9y ago

CUDA is made by nvidia

baldfat 9y ago
Not sure why you were down voted. CUDA is developed by NVIDIA. CUDA is a registered trademark by NVIDIA - https://trademarks.justia.com/850/30/cuda-85030071.html https://trademarks.justia.com/850/30/cuda-85030071.html Here is the CUDA webpage https://developer.nvidia.com/cuda-zone https://developer.nvidia.com/cuda-zone
- iforgotpassword 9y ago
  Because it's a pointless answer that basically just repeats part of the question, providing absolutely no new information.
  - baldfat 9y ago
    Well I think it makes a short answer NVIDIA doesn't let their proprietary CUDA technology work on non-NVIDIA devices.

orbifold 9y ago

No there isn't, Google developed a CUDA frontend for clang/llvm which targets PTX (nvidias virtual machine instruction set), in principle someone could come along and implement a different backend for this frontend targeting for example AMDs gpu instruction architecture or something different. The other ingredient missing is a reimplementation of CUDAs runtime libraries.

cjalmeida 9y ago
The last part is particularly important. Most deep learning libs rely on things like cuDNN which implement by hand basic operations very efficiently. The ROCm initiative by AMD already "transpile" most CUDA kernels to being AMD compatible, but it seems performance is not yet comparable in real word benchmarks.

bryanlarsen 9y ago

AMD is working on a tool to convert CUDA code: https://github.com/ROCm-Developer-Tools/HIP https://github.com/ROCm-Developer-Tools/HIP

rodburns 9y ago

We are working on an OpenCL based layer that enables AMD GPUs, see these links for more info https://developer.codeplay.com/computecppce/latest/getting-started-with-tensorflow https://developer.codeplay.com/computecppce/latest/getting-s... https://github.com/tensorflow/tensorflow/issues/22 https://github.com/tensorflow/tensorflow/issues/22