4 ms·
> 282 GB is split between two GPUs There is only one GPU in GH200 and it gets all 282 GB HBM3e memory. There is another 480 GB LPDDR5X memory for the another
by nabla9 3y ago
> 282 GB is split between two GPUs
There is only one GPU in GH200 and it gets all 282 GB HBM3e memory.
There is another 480 GB LPDDR5X memory for the another chip (Grace CPU, not GPU).
GH200 interconnect bandwidth trough NVLink is 900 GB/s.
- modeless 3y agoI don't believe this is true. GH200's GPU has 144GB of HBM3e according to their datasheet. https://resources.nvidia.com/en-us-grace-cpu/grace-hopper-superchip https://resources.nvidia.com/en-us-grace-cpu/grace-hopper-su... The 282 GB figure comes from a "dual configuration" server with two CPU chips and two GPU chips: > the new platform will be available in a wide range of configurations. The dual configuration [...] comprises a single server with 144 Arm Neoverse cores, eight petaflops of AI performance and 282GB of the latest HBM3e memory technology. Note that one Grace Hopper CPU has 72 cores so this configuration clearly has two CPUs and two GPUs in one server, and the 282 GB HBM3e total is split between the two GPUs with 144 GB each (again, not sure where the extra 6 GB went, maybe disabled for yield issues?). https://nvidianews.nvidia.com/news/gh200-grace-hopper-superchip-with-hbm3e-memory https://nvidianews.nvidia.com/news/gh200-grace-hopper-superc...