The A100 is not optimised for pure ieee-754 FP throughput it seems but for more specialised forms of FP and bandwidth. https://www.nvidia.com/content/dam/en-zz

The A100 is not optimised for pure ieee-754 FP throughput it seems but for more specialised forms of FP and bandwidth. https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...