3 ms·
Deep Dive on Google's Exascale TPUv4 AI Systems
- dekhn 4y agoI worked a bit on TPUv4 in my last role at Google a couple years ago. I have to say I really like the interconnect design. It's the closest to a real supercomputer that I've seen Google make, but with some nice capabilities to dynamically reconfigure the fiber paths using MEMS. Combined with the 3D torus and a few other TPUv4 features, this is a large-scale machine learning monster.