4 ms·
I haven't done any CUDA programming, however I have wanted to dive in. I've been to some conferences where the breakpoint between whether CUDA gives enough bene
by lrm242 16y ago
I haven't done any CUDA programming, however I have wanted to dive in. I've been to some conferences where the breakpoint between whether CUDA gives enough benefit to the computation is largely driven by time to load a dataset into memory on the GPU. From what I've been told this has limited the use of CUDA to batch processing on large scale datasets. Is this still a limitation?
- tmurray 16y agoPCIe can be a limitation, but there are a lot of ways to amortize the latency of copying data to/from the GPU. Overlapping transfers with kernels, direct load/store from system memory to a kernel, multiple kernels running on the chip at the same time--there are a lot of things you can do. But in general, you're looking at a runtime of at least a few hundred microseconds before you're going to be able to get a benefit from the GPU.