4 ms·
Also, moving things to the GPU may be good for throughput but bad for latency depending on the workload, since offloading to GPU has a cost and data exchanges t
by ivegotnoaccount 4y ago
Also, moving things to the GPU may be good for throughput but bad for latency depending on the workload, since offloading to GPU has a cost and data exchanges too.
- femto 4y agoAgree. Real-time signal processing with feedback loops is a case in point.
- rbanffy 4y ago> offloading to GPU has a cost and data exchanges too. This is bad with dGPUs over the PCIe bus, but not so much with GPUs that share a very fast memory bus with the CPU. In this case, the layout of the data may prove challenging to keep the same for when you use a CPU and a GPU.