4 ms·
That's not nearly as true when you look at AI training clusters. They're basically supercomputers but without an FP64 focus. (These are the systems to which GP
by dgacmu 4mo ago
That's not nearly as true when you look at AI training clusters. They're basically supercomputers but without an FP64 focus.
(These are the systems to which GP was referring at Google.)
- jeffbee 4mo agoI thought TPUs couldn't reasonably run LINPACK at all because TPUs do not acknowledge that FP64 exists. I know Google wants to compare their stuff to El Capitan or whatever but the comparison does not seem valid to me.
- cynicalkane 4mo agoEven before AI training clusters became important, Google has had an outstanding custom fabric (there's papers about it) together with the ability to tune NICs for their own cases, and "their own cases" meant nearly everything engineered within Google. Ethernet hardware has had low kernel latency and DMA for a long time; it's the rest of the stack that hurts. But as far back as the early 2010s (if not further back, that goes beyond my knowledge horizon), you could just make it not hurt, if you had the software engineers to do it.
- mrlongroots 4mo agoAll that would not help you with an AI training cluster interconnect. See Amin Vahdat's keynote at HotInterconnects 2025. Everyone is building a fabric for this stuff from scratch (Google/Falcon, Amazon/EFA, Azure/MANA, Cornelis/CN5000, and obviously Mellanox).