4 ms·
How does a DGX Pod w/ the new 3.2Tbps per machine NVLINK switch compare to Tesla Dojo?
by virtuallynathan 5y ago
How does a DGX Pod w/ the new 3.2Tbps per machine NVLINK switch compare to Tesla Dojo?
- TomVDB 5y agoWhen you take software support into account, probably very favorable. I don’t know anything about the state of Dojo, but Tesla was very hand wavy about their software stack during their presentation. And running AI algorithms efficiently on a piece of hardware is one of those things that many HW vendors have a hard time getting right.
- virtuallynathan 5y agoTesla Dojo Training tile (25x D1): 565 TF FP32 / 9 PF BF16/CFP8 / 11GB SRAM / 10kW NVIDIA DGX H100 (8x H100): 480 TF FP32 / 8 PF+ TF16 / 16 PF INT8 / 640GB HBM3 / 10kW Dojo off-chip BW: 16 TB/s / 36TB/s off-tile H100 off-chip BW: 3.9TB/s / 400GB/s off-DGX