3 ms·

A100 has 10x or so higher mem bandwidth

• egorfine 2y ago
  Per nvidia [1] A100 has memory bandwidth up to 2,039. So not 10x, more like 2x. [1] https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...
  • kristianp 2y ago
    That's for 1, they were asking about 8x A100s, so 16x. H100 is double again.