3 ms·Nvidia's H100 has 80GB. As long the interconnect is fast enough you don't need everything to fit on one.by vidarh 2y agoNvidia's H100 has 80GB. As long the interconnect is fast enough you don't need everything to fit on one.