4 ms·
The unified memory is no faster for the GPU than the CPU. So its not 10x the CPU. HBM on a GPU is much faster.
by justincormack 2y ago
The unified memory is no faster for the GPU than the CPU. So its not 10x the CPU. HBM on a GPU is much faster.
- trhway 2y agoNo. The unified memory on GB10 is much faster than regular RAM to CPU system: https://nvidianews.nvidia.com/news/nvidia-puts-grace-blackwell-on-every-desk-and-at-every-ai-developers-fingertips https://nvidianews.nvidia.com/news/nvidia-puts-grace-blackwe... "The GB10 Superchip enables Project DIGITS to deliver powerful performance using only a standard electrical outlet. Each Project DIGITS features 128GB of unified, coherent memory and up to 4TB of NVMe storage. With the supercomputer, developers can run up to 200-billion-parameter large language models to supercharge AI innovation." https://www.nvidia.com/en-us/data-center/grace-cpu-superchip/ https://www.nvidia.com/en-us/data-center/grace-cpu-superchip... "Grace is the first data center CPU to utilize server-class high-speed LPDDR5X memory with a wide memory subsystem that delivers up to 500GB/s of bandwidth " As far as i see it is about 4x of Zen 5.