Indeed, much like the pending AMD Strix Halo and already chipping AMD MI300A. Much like dual socket servers, where each socket can address all memory, these ne

Indeed, much like the pending AMD Strix Halo and already chipping AMD MI300A. Much like dual socket servers, where each socket can address all memory, these new servers have two memory systems, one optimized for CPU and another optimized for GPU. Seems like a good idea to me, why serial/deserialize complex data structures between the CPU and GPU, which are then bulk transfered, and then checked for completion. With NUMA you can pass a pointer, caches help, everything is coherent, and it "just works". No more failures when you don't have enough memory for textures or a LLM, it would just gracefully page to the CPUs memory.