3 ms·
Yes, this AVX-512F instruction makes fp16 to fp32 efficient: https://software.intel.com/sites/landingpage/IntrinsicsGuide/#text=_mm512_cvtph_ps&expand=2107,210
by 37ef_ced3 5y ago
Yes, this AVX-512F instruction makes fp16 to fp32 efficient:
https://software.intel.com/sites/landingpage/IntrinsicsGuide/#text=_mm512_cvtph_ps&expand=2107,2107 https://software.intel.com/sites/landingpage/IntrinsicsGuide...
The result is that Winograd convolutions can achieve an effective FMA rate of twice the peak rate of the CPU.
The Winograd transform reduces the required number of FMAs by a factor of 5x, but you can only do FMAs at half peak rate (because you are bandwidth limited), so you come out ahead by a factor of 2.5x in theory (2x in practice).
Without fp16, that 2x advantage would be lost.