VRAM runs at high frequencies, delivers insane throughput, but the latency is not great. GPUs don’t need low memory latency. They have very high degree of paral

VRAM runs at high frequencies, delivers insane throughput, but the latency is not great. GPUs don’t need low memory latency. They have very high degree of parallelism. GPU cores switch to other threads instead of waiting for data from memory. Here’s an interesting system with AMD Zen2 CPU and GDDR6 memory, salvaged from XBox: https://www.tomshardware.com/news/4800s-xbox-chip-shows-us-why-cpus-do-not-come-with-gddr6 https://www.tomshardware.com/news/4800s-xbox-chip-shows-us-w... As you see, high latency of GDDR6 memory ruins the performance of CPU-running code.