3 ms·
Do you think there’s a call for introducing an even smaller float that can pack more values into a SIMD register? Like a 12 bit?
by hinkley 2y ago
Do you think there’s a call for introducing an even smaller float that can pack more values into a SIMD register? Like a 12 bit?
- boulos 2y agoThe latest GPUs and TPUs support fp8. It's a big part of the efficiency gain in the latest systems. Blackwell also supports fp4.