3 ms·
This is incredible. I really like how you're able to trace the evolution of the systems as well. It makes me wonder what the next hardware revolution will be.
by _gabe_ 4y ago
This is incredible. I really like how you're able to trace the evolution of the systems as well.
It makes me wonder what the next hardware revolution will be. It seems like most resource intense applications are bottlenecking at transferring memory. UE5's nanite tech hinges on the ability to transfer memory directly from disk to GPU, Netflix built specific hardware to avoid copying memory between userspace and hardware, and I wonder how much other performance we're missing out on because we can't transfer memory fast enough.
How much faster could AI training be if we could get memory directly from disk to the GPU and avoid the CPU orchestrating it all? What about video streaming? I have a feeling these processes already use some clever tricks to avoid unnecessary trips through the CPU, but it will be interesting to see which direction hardware goes with this in mind.
- aftbit 4y agoThis is definitely the direction that things are going. In the GPU space, see things like GPUDirect[1]. In networking and storage, especially for hyperscale stuff, see the rise of DPUs[2] replacing CPUs. 1: https://developer.nvidia.com/gpudirect https://developer.nvidia.com/gpudirect 2: https://www.servethehome.com/what-is-a-dpu-a-data-processing-unit-quick-primer/ https://www.servethehome.com/what-is-a-dpu-a-data-processing...