4 ms·
The CPU / RAM is a bottleneck between the persistent storage and the fast GPU. There's a well-known way to increase network throughput and reduce latency by ru
by nine_k 10y ago
The CPU / RAM is a bottleneck between the persistent storage and the fast GPU.
There's a well-known way to increase network throughput and reduce latency by running a whole dedicated IP stack + hardware driver in the user space of the process that needs it. This removes the bottleneck of the OS kernel.
I wonder if there's a way to remove the bottleneck in the GPU case by something similar, by dedicating a piece of hardware to the SSD interconnect without having a CPU as an intermediary. AFAICT you still cannot DMA from a disk directly to GPU RAM, even though you have enough PCIe lanes coming to the GPU. Is this true? If so, can it change in a way that is still compatible with traditional, "normal" operation of the PC architecture?