2 ms·
1979 16 bit flops on an H100 is with sparsity. See footnote 2 on https://www.nvidia.com/en-us/data-center/h100/ https://www.nvidia.com/en-us/data-center/h100/.
by aschleck 3y ago
1979 16 bit flops on an H100 is with sparsity. See footnote 2 on https://www.nvidia.com/en-us/data-center/h100/ https://www.nvidia.com/en-us/data-center/h100/. You should be halving it for non-sparse flops.
- YetAnotherNick 3y agoGP is correct. With sparsity it is 3958. 1979 Tflop/s is without sparsity.
- emu 3y agoNo, it is not. That's the sparse fp8 flop number, but you need to ignore sparsity and compare bf16 flops not fp8 flops for the comparison the ancestor post is making.