3 ms·
How does the 500gb vram compare with 8xA100s ? ($15/hr rentals) If it is equivalent, then the machine pays for itself in 300 hours. That's incredible value.
by screye 2y ago
How does the 500gb vram compare with 8xA100s ? ($15/hr rentals)
If it is equivalent, then the machine pays for itself in 300 hours. That's incredible value.
- awestroke 2y agoA100 has 10x or so higher mem bandwidth
- egorfine 2y agoPer nvidia [1] A100 has memory bandwidth up to 2,039. So not 10x, more like 2x. [1] https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...
- kristianp 2y agoThat's for 1, they were asking about 8x A100s, so 16x. H100 is double again.