3 ms·
Does this pay more than $500k/yr? I already know C++, could be tempted to learn CUDA.
by 8n4vidtmkvmk 2y ago
Does this pay more than $500k/yr? I already know C++, could be tempted to learn CUDA.
- throwaway81523 2y agoI kinda doubt it. Nobody paid me to do that though. I was just interested in LCZero. To get that $500k/year, I think you need up to date ML understanding and not just CUDA. CUDA is just another programming language while ML is a big area of active research. You could watch some of the fast.ai ML videos and then enter some Kaggle competitions if you want to go that route.
- almostgotcaught 2y agoYou're wrong. The people building the models don't write CUDA kernels. The people optimizing the models write CUDA kernels. And you don't need to know a bunch of ML bs to optimize kernels. Source: I optimize GPU kernels. I don't make 500k but I'm not that far from.
- throwaway81523 2y agoHeh I'm in the wrong business then. Interesting. Used to be that game programmers spent lots of time optimizing non-ML CUDA code. They didn't make anything like 500k at that time. I wonder what the ML industry has done to game development, or for that matter to scientific programming. Wow.
- HarHarVeryFunny 2y agoHow much performance difference is there between writing a kernel in a high level language/framework like PyTorch (torch.compile) or Triton, and hand optimizing? Are you writing kernels in PTX? What's your opinion on the future of writing optimized GPU code/kernels - how long before compilers are as good or better than (most) humans writing hand-optimized PTX?
- throwaway81523 2y agoThe CUDA version of LCZero was around 2x or 3x faster than the Tensorflow(?) version iirc.
- deleted 2y ago[deleted]