5 ms·
>Pretty much only CUDA is not open source. What stops Intel to make their own CUDA and plug in into pytorch?
by DeathArrow 3y ago
>Pretty much only CUDA is not open source.
What stops Intel to make their own CUDA and plug in into pytorch?
- mschuster91 3y agoThe same shit as always, patents and copyright.
- nemothekid 3y agoCUDA is huge and nvidia spent a ton in a lot of "dead end" use cases optimizing it. There have been experiments with CUDA translation layers with decent performance[1]. There are two things that most projects hit: 1. The CUDA API is huge; I'm sure Intel/AMD will focus on what they need to implement pytorch and ignore every other use case ensuring that CUDA always has the leg up in any new frontier 2. Nvidia actually cares about developer experience. The most prominent example is Geohotz with tinygrad - where AMD examples didn't even work or had glaring compiler bugs. You will find nvidia engineer in github issues for CUDA projects. Intel/AMD hasn't made that level of investment and thats important because GPUs tend to be more fickle than CPUs. [1] https://github.com/vosen/ZLUDA https://github.com/vosen/ZLUDA