4 ms·
> And sadly, Nvidia does not support OpenCL’s FP16 extension, so FP16 throughput couldn’t be tested What a bummer. But is this really true? I know Nvidia does
by nromiun 3y ago
> And sadly, Nvidia does not support OpenCL’s FP16 extension, so FP16 throughput couldn’t be tested
What a bummer. But is this really true? I know Nvidia does not report the cl_khr_fp_16 extension, but I saw somewhere that you can still use fp16 types in your code. Has anyone tested this?
- ZiiS 3y agoYes FP16 is fully optimised on NVidia hardware; but if you don't support standards...
- Lerc 3y ago...You gain a near monopoly by getting people to use your proprietary stack?
- misnome 3y ago... which you created when none of the other stacks existed, and stood behind for 20 years while all your competitors changed their mind about everything every couple of years.
- jimmySixDOF 3y agoI notice they didn't test against TPUv5 either ...
- dhruvdh 3y agoWouldn't surprise me if it's impossible to test against TPUs with Google not sharing low-level technical information and documentation from users.