3 ms·

What happened to the H100 NVL? https://www.anandtech.com/show/18780/nvidia-announces-h100-nvl-max-memory-server-card-for-large-language-models https://www.anan

• brucethemoose2 3y ago
  I dunno. But thats a dual GPU product, so its not really 180GB.
  • az226 3y ago
    They are also doing a custom 4 chip Hopper GPU for a European HPC initiative. Seems like a good move. Basically allows you to have 4 H100s connected via NVLink without needing a separate SXM board.
    • latchkey 3y ago
      I'm holding out for 8 x MI300x on a single board. =)
• jauntywundrkind 3y ago
  This is a single-chip H100 NVL. Both are GH100's with the same tweaked 20% wider 6144-bit HBM3e (versus 5120 bit on other H100's) running at a higher speed. The HBM3e loadout is slightly different than H100 NVL's was going to be, but this definitely seems like a higher bin H100. It's basically as-if AMD had shipped a 7900 XT, then latter started selling the 7900 XTX; same chip, but they brought up all the memory controllers on this one.