2 ms·
> While this version only supports host memory as that was the initial target, other memory types are planned as well, with notably GPU memory coming next. Awh
by jauntywundrkind 2y ago
> While this version only supports host memory as that was the initial target, other memory types are planned as well, with notably GPU memory coming next.
Awhhh yeah. Return to PacketShader (2010)!
Honestly not sure if there are use cases for GPU routing.
More likely use case would probably be feeding LLMs data over the network with lower overhead. I'm not sure what's possible today with PCIe p2p dma, how much this io_uring capability could potentially improve those direct-to-GPU scenarios. https://docs.kernel.org/driver-api/pci/p2pdma.html https://docs.kernel.org/driver-api/pci/p2pdma.html