3 ms·
I'll just leave this here. :-X Bfloat16 is much better for conversions from f32. https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/framewor
by ndesaulniers 8y ago
I'll just leave this here. :-X
Bfloat16 is much better for conversions from f32.
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/framework/bfloat16.h https://github.com/tensorflow/tensorflow/blob/master/tensorf...
- stephencanon 8y agoIt’s definitely conceptually simpler, but both conversions are a single fully-pipelined operation on any CPU made in the past 5 years, and can be folded into the arithmetic operation on custom HW. In practice the cost of conversion isn’t really an issue; the win with bfloat16 is the added dynamic range.