3 ms·
It means to bring the range of the vector to between 0 and 1. In this case the operation is a simple division by a constant, and the argument is that you can de
by thegeomaster 4y ago
It means to bring the range of the vector to between 0 and 1. In this case the operation is a simple division by a constant, and the argument is that you can decide on this constant per-vector so that you maximize the utilization of this space between 0 and 1.
If you'd have squished both by 4, the second vector would be [0, 0.5, 0.5, 0], leaving essentially half the quantization space (0.5-1.0) unused, and leaving you with less precision.
- michaelbarton 4y agoAh, I think I got it, thanks. The broader range is the range (0-1) as opposed to (0-0.5)? This is what the author means by "This will give you twice the precision to quantize the second vector because the inputs are now spread over a broader range of the I3 data type."?
- thegeomaster 4y agoPrecisely.