4 ms·
They're counting TF32, which is a 19 bit format and comparing it to FP64.
by KenoFischer 6y ago
They're counting TF32, which is a 19 bit format and comparing it to FP64.
- arcanus 6y agoIt's tensor Ops, and so the precision might be even lower than single. It could be BF16, for example.