2 ms·
If you're going to bother doing floats you should probably make them balanced around 1. And exponent seems to be much more important for these small sizes. Th
by Dylan16807 4y ago
If you're going to bother doing floats you should probably make them balanced around 1.
And exponent seems to be much more important for these small sizes. The first paper that shows up for FP4 almost has negative mantissa bits. Their encoding has 0, 1/64, 1/16, 1/4, 1, 4, 16, 64.