4 ms·
On GPUs, fp16 is quite a bit more power-efficient (and bandwidth-efficient) than fp32.
by cwzwarich 9y ago
On GPUs, fp16 is quite a bit more power-efficient (and bandwidth-efficient) than fp32.
- wtallis 9y agoAren't there problems with FP16 support being far from universal, and many GPUs having far less FP16 throughput than FP32? In some situations FP16 is definitely a better choice, but I don't think it can be given as a blanket recommendation.
- cwzwarich 9y agoI work exclusively on embedded GPUs these days, so I was surprised to read this. It's easy to repurpose FP32 hardware to at least support FP16 without reduced performance. However, seems that Nvidia has intentionally reduced FP16 performance on some consumer products for market segmentation reasons.