3 ms·
This issue also matters within the computer - the bandwidth between main memory and a GPU connected by PCI Express is close to the bandwidth between main memory
by scott_s 16y ago
This issue also matters within the computer - the bandwidth between main memory and a GPU connected by PCI Express is close to the bandwidth between main memory and the CPU. (On one machine I used for experiments PCI Express was 8 GB/s while the front-side bus was 12 GB/s.)
But the difference in latency is so big that you have to use different memory transfer strategies when using the GPU for computations than when using the CPU.