3 ms·
don't waste your time on cuda. Wait until an open artitecture replaces this proprietary clusterf*ck
by singularity2001 8y ago
don't waste your time on cuda. Wait until an open artitecture replaces this proprietary clusterf*ck
- brutus1213 8y agoI disagree partly. Cuda is defacto in DL at the moment, and is very well designed. It has academic roots and the neat ideas shine out. Why did I say partly? So many optimization layers exist already (e.g. BLAS/cuBLAS). One may not really need to get down to the CUDA level.
- skohan 8y agoWhat if anything does Cuda do better/differently than OpenCL?
- keldaris 8y agoCUDA itself does only one thing better - it lets you write kernels in C++ rather than a fairly restrictive subset of C. Far more importantly, it has a large ecosystem of tooling (including excellent profiling tools), libraries, documentation and open source projects out there. Comparatively speaking, OpenCL is a barren landscape.
- codehd7 8y agoSYCL layer/standard adds "C++ Single-source Heterogeneous Programming" for OpenCL: https://www.khronos.org/sycl/ https://www.khronos.org/sycl/
- keldaris 8y agoThat it does and there's also plenty of convenience wrappers of various kinds for different languages. Unfortunately, none of that can address the ecosystem issue, which is the one that really matters.
- goldenkey 8y agoCuda has Cooperative Groups now on Volta and Turing architectures. This allows for synchronization between entire workgroups rather than just locally. So you can pretty much keep your entire job on the GPU even if it involves multiple kernels. Really important for complex jobs where performance is a must. https://devblogs.nvidia.com/cooperative-groups https://devblogs.nvidia.com/cooperative-groups
- twtw 8y agoGiven that AMDs approach has shifted to implementing cuda (under the name "hip") and providing tools to automatically find/replace cuda to hip, I don't think the cuda api is going anywhere.