4 ms·
Is that not what this is? https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#concurrent-kernel-execution https://docs.nvidia.com/cuda/cuda-c-progr
by oivey 6y ago
Is that not what this is? https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#concurrent-kernel-execution https://docs.nvidia.com/cuda/cuda-c-programming-guide/index....
I thought this allowed kernels to run in parallel if both kernels could fit in the open resources. It doesn't have a priority system, and I'm guessing isn't smart enough to reorder kernels to fit together better. Further Googling to be sure that they mean parallel AND concurrent didn't turn up much, but Nvidia does appear to mean both.
- my123 6y agocudaStreamCreateWithPriority is what you'd like to use for creating a stream with a specifically defined priority. The GPU is able to run up to 128 kernels in parallel on modern NVIDIA GPUs, concurrently.
- oivey 6y agoAhh ok. I’ve had a similar conversation with a graphics guy that strongly paralleled this conversation, and I was confused then, too. Seemingly the asynchronous compute issues are a limitation when it only comes to shaders I guess? I write some CUDA but no shaders, and certainly not so much that I’d make super concrete claims about more esoteric features like streams.