2 ms·

either I'm misinformed in which case is like to see proof, or you are, but GB200 is not Gen6, just Gen5 and this will only be rectified with GB300 which, while

either I'm misinformed in which case is like to see proof, or you are, but GB200 is not Gen6, just Gen5 and this will only be rectified with GB300 which, while exists in the wild, is not in the millions. so indeed the parent commenter would be correct that everything is Gen5 right now.

zamadatix 1y ago
I'm going off of https://developer.nvidia.com/blog/nvidia-gb200-nvl72-delivers-trillion-parameter-llm-training-and-real-time-inference/?utm_source=chatgpt.com#:~:text=The%20GB200%20has%20cold%20plates%20and%20connections%20for%20liquid%20cooling%2C%20PCIe%20gen%206%20support https://developer.nvidia.com/blog/nvidia-gb200-nvl72-deliver... but I have not actually deployed a GB200 system yet myself. Consumer Blackwell is definitely 5.0 though.
- _zoltan_ 1y ago
  that article is from last March. the plan was indeed for the GB200 board to support gen6 but it didn't happen and GB300 will rectify it. at least that's my best educated guess, looking at supermicro's public spec sheet and that it's shipping with CX7 which is Gen5 and not with CX8. B200 supports Gen6 there is just nothing that would let it run at Gen6.
  - zamadatix 1y ago
    At least the GB200s OpenAI purchased have CX-8s, but it's very possible (perhaps even very likely) most of the millions of GB200s deployed PCIe 5.0 using CX-7s given the SuperMicro spec sheet. Edit: found this SemiAnalysis post saying as much https://x.com/SemiAnalysis_/status/1947768988467138645/photo/1 https://x.com/SemiAnalysis_/status/1947768988467138645/photo...
    - _zoltan_ 1y ago
      thanks! very interesting that they got a custom SKU.
- jsolson 1y ago
  Datacenter Blackwell is Gen6, which is critical when pairing it with CX8 (2x400G) as otherwise you'd be stranding NIC BW.
  - _zoltan_ 1y ago
    please link me a B200 (not a B300) system with CX8 that uses gen6 x16 instead of gen5 x32. to the best of my knowledge this does not exist, but I'd be happy to stand corrected. (the official NVIDIA DGX B200 is gen5).

zamadatix 1y ago

I'm going off of https://developer.nvidia.com/blog/nvidia-gb200-nvl72-delivers-trillion-parameter-llm-training-and-real-time-inference/?utm_source=chatgpt.com#:~:text=The%20GB200%20has%20cold%20plates%20and%20connections%20for%20liquid%20cooling%2C%20PCIe%20gen%206%20support https://developer.nvidia.com/blog/nvidia-gb200-nvl72-deliver... but I have not actually deployed a GB200 system yet myself. Consumer Blackwell is definitely 5.0 though.

_zoltan_ 1y ago
that article is from last March. the plan was indeed for the GB200 board to support gen6 but it didn't happen and GB300 will rectify it. at least that's my best educated guess, looking at supermicro's public spec sheet and that it's shipping with CX7 which is Gen5 and not with CX8. B200 supports Gen6 there is just nothing that would let it run at Gen6.
- zamadatix 1y ago
  At least the GB200s OpenAI purchased have CX-8s, but it's very possible (perhaps even very likely) most of the millions of GB200s deployed PCIe 5.0 using CX-7s given the SuperMicro spec sheet. Edit: found this SemiAnalysis post saying as much https://x.com/SemiAnalysis_/status/1947768988467138645/photo/1 https://x.com/SemiAnalysis_/status/1947768988467138645/photo...
  - _zoltan_ 1y ago
    thanks! very interesting that they got a custom SKU.
jsolson 1y ago
Datacenter Blackwell is Gen6, which is critical when pairing it with CX8 (2x400G) as otherwise you'd be stranding NIC BW.
- _zoltan_ 1y ago
  please link me a B200 (not a B300) system with CX8 that uses gen6 x16 instead of gen5 x32. to the best of my knowledge this does not exist, but I'd be happy to stand corrected. (the official NVIDIA DGX B200 is gen5).