4 ms·
Half precision ftw! ML is the use case they're designing for, but we all get to reap the benefits.
by wyldfire 11y ago
Half precision ftw! ML is the use case they're designing for, but we all get to reap the benefits.
- pavlov 11y agoHasn't half precision (16-bit float) been in NVidia GPUs forever? I could swear it was available back in the very first shader-capable Geforce FX days already.
- wyldfire 11y agoIIRC what's new here is native support in the ALUs, etc. I think the older support was probably in software.
- bsprings 11y ago(Post author here.) Yes, FP16 has been supported in NVIDIA GPUs as a texture format "forever" -- since before it was incorporated into the IEEE 754 standard. Indeed what is new in GP100 is hardware ALU support (and note denormals are full speed, which is even more important for lower precision formats).