3 ms·
The FLOPs quoted by national lab supercomputers are usually measured double-precision FLOPs from HPL (High-performance Linpack - at least on the Top500 reports)
by fluffything 6y ago
The FLOPs quoted by national lab supercomputers are usually measured double-precision FLOPs from HPL (High-performance Linpack - at least on the Top500 reports).
IIUC, HPL can use double-precision tensor operations. It might also be able to use mixed-precision for some computations.
Are the performance numbers for this HPC system at University of Florida also from HPL ?
- jabl 6y ago> IIUC, HPL can use double-precision tensor operations. Lets put it this way: As of the A100 GPU generation, the tensor cores are able to do double precision calculations too. By using the tensor core the peak FP64 flops double to 19.5 Tflops. And yes, the CUDA BLAS library (that the HPL benchmark uses) uses the tensor cores on the A100. > It might also be able to use mixed-precision for some computations. There is currently a lot of interest in mixed precision algorithms, but I'm not sure that the algorithm used for HPL is amenable to that approach, nor whether it's allowed per the benchmark rules.