4 ms·
Does anyone know of good tutorials for CUDA programming incl debugging? Especially one that also covers the recommended way to bind w/PyTorch? I've always foun
by upbeat_general 4y ago
Does anyone know of good tutorials for CUDA programming incl debugging? Especially one that also covers the recommended way to bind w/PyTorch?
I've always found writing CUDA kernels to be a bit unapproachable.
- synergy20 4y agoI kind of feel there are two different levels of sw development for CUDA. 1. CUDA level programming for graphic processing etc, or writing a c/c++ library for Pytorch/tensorflow framework. 2. Pytorch/Tensorflow level coding(e.g. training a model), you just pick their CUDA-specific APIs, and the two frameworks handle the rest under the hood, no CUDA specific coding details(point 1 above) is required from the users as far as I can tell. if you're interested in 1, Nvidia has c++ guide to download, if you're interested in 2, then the focus is on the AI framework instead of CUDA.
- serial_dev 4y agoCUDA by Example helped me a lot learning about general purpose GPU programming. It doesn't cover Python, PyTorch at all though.
- arpankapoor 4y agoI found the introductory chapters (1-3) of this book[0] quite good. It is different from the NVIDIA CUDA C++ guide in that it uses modern C++ and has non-trivial real-world examples. I also wrote a blog post [1] exploring CUDA to write a simple CNN inference module which you might find useful. [0]: https://www.cambridge.org/core/books/programming-in-parallel-with-cuda/C43652A69033C25AD6933368CDBE084C https://www.cambridge.org/core/books/programming-in-parallel... [1]: https://arpankapoor.com/cuda https://arpankapoor.com/cuda
- zmgsabst 4y agoI don’t know a good tutorial, but numba’s CUDA is good for learning on your own projects. I made some automata engines with that framework. http://numba.pydata.org/numba-doc/latest/cuda/ http://numba.pydata.org/numba-doc/latest/cuda/