3 ms·
The H100 theoretical flops number is just marketing, as it relies on sparsity that LLMs don’t use
by cavisne 2y ago
The H100 theoretical flops number is just marketing, as it relies on sparsity that LLMs don’t use
- az226 2y agoAnd the practical flops always end up lower. As an example a V100 has 125 according to spec, but the ideal case is more like 100 and non-ideal like 60.