41 ms·
Hi, can something along these lines also be used to speed up loading of models running in the GPU memory? With a GDDR6X memory bandwidth of 936 GB/s and PCIe 4
by Tepix 4y ago
Hi, can something along these lines also be used to speed up loading of models running in the GPU memory?
With a GDDR6X memory bandwidth of 936 GB/s and PCIe 4.0 x16 bandwidth of 64GB/s loading something like 20GB into the VRAM of an RTX 3090 shouldn't take longer than 1/2 a second or so, right? (assuming it is in the kernel cache)