3 ms·
for TPUv3 it's 2D torus, not hyper-cube, right? Not sure if TPUv4 topology is externally published, but IIRC hypercubes are basically never used any more.
by dekhn 5y ago
for TPUv3 it's 2D torus, not hyper-cube, right? Not sure if TPUv4 topology is externally published, but IIRC hypercubes are basically never used any more.
- vl 5y agoI mistyped, one version is 2D torus, next is 3D torus aka hypertorus.