3 ms·
> GPUs can only do 1 thing at a time Wut? Modern GPUs(ahem, Nvidia) can pipeline very effectively. You can copy to and from the GPU while the GPU is busy wor
by 01100011 6y ago
> GPUs can only do 1 thing at a time
Wut? Modern GPUs(ahem, Nvidia) can pipeline very effectively. You can copy to and from the GPU while the GPU is busy working on something already loaded into memory. True, host copies suck, but you can hide them behind compute delays in many workloads.
With GPUDirect, you can even skip the CPU and DMA straight between the GPU and I/O(storage or network controller).