Your parent comment (by my reading) implied the H100 "does just fine" when it has 50MB SRAM. The reason Grok needs multiple racks of chips to serve up models t

Your parent comment (by my reading) implied the H100 "does just fine" when it has 50MB SRAM. The reason Grok needs multiple racks of chips to serve up models that fit in a single H100 is because Grok chips are SRAM only while the H100 has 80GB of HBM VRAM bolted onto it in addition to SRAM.