3 ms·
I assume that should be "and can hide latency"? While GPU offloading is extremely powerful in terms of compute, you have to deal with both bandwidth limitation
by atq2119 8y ago
I assume that should be "and can hide latency"?
While GPU offloading is extremely powerful in terms of compute, you have to deal with both bandwidth limitations (de facto ~12 GB/s for x16 PCIe 3.0) and the latency of launching compute kernels and waiting for them to complete.
- jacquesm 8y agoThat depends on the problem space. For some problems latency does not need to be an issue, if the problem can be pipe-lined then you can keep all your cores running at a high percentage of their theoretical maximum load even if latency is high. For real time applications this is usually not an option, there latency > some threshold will kill your proposed solution.
- atq2119 8y agoIn those cases where the latency is not a problem, it tends to be precisely because you can hide it e.g. via pipelining :)
- slededit 8y agoYou overcome the bottleneck by doing as much as possible on the GPU. Even things you don’t think are fully suited to it.