3 ms·
> IIUC, HPL can use double-precision tensor operations. Lets put it this way: As of the A100 GPU generation, the tensor cores are able to do double precision c
by jabl 6y ago
> IIUC, HPL can use double-precision tensor operations.
Lets put it this way: As of the A100 GPU generation, the tensor cores are able to do double precision calculations too. By using the tensor core the peak FP64 flops double to 19.5 Tflops. And yes, the CUDA BLAS library (that the HPL benchmark uses) uses the tensor cores on the A100.
> It might also be able to use mixed-precision for some computations.
There is currently a lot of interest in mixed precision algorithms, but I'm not sure that the algorithm used for HPL is amenable to that approach, nor whether it's allowed per the benchmark rules.