2 ms·
How are they connected? PCIe? Something like NVLink?
by alecco 2y ago
How are they connected? PCIe? Something like NVLink?
- tucnak 2y agoOptical circuit switches https://arxiv.org/abs/2304.01433 https://arxiv.org/abs/2304.01433
- nl 2y agoThey use custom optical "Interchip Interconnect" within each 256-chip "pod" and their custom "Jupiter" networking between pods. See https://cloud.google.com/blog/products/compute/introducing-trillium-6th-gen-tpus https://cloud.google.com/blog/products/compute/introducing-t... and https://cloud.google.com/blog/topics/systems/the-evolution-of-googles-jupiter-data-center-network?e=48754805 https://cloud.google.com/blog/topics/systems/the-evolution-o...