3 ms·
One or both of us have lost the thread here. There was an exchange about using fixed point (which apparently is being used according to other comments for easi
by psychphysic 4y ago
One or both of us have lost the thread here.
There was an exchange about using fixed point (which apparently is being used according to other comments for easier correctness verification, speed and simplicity). Someone pointed out that float gives you a wider range of values. But those values are not needed for cosine which has a range of 0-1 in the interval 0 to pi/2.
- dahart 4y ago> But those values are not needed for cosine which has a range of 0-1 in the interval 0 to pi/2 Ah not quite true though; the “range” is also referring to the exponent range of representable numbers, so don’t forget the small numbers near 0. You can get much smaller numbers with much higher precision out of a single-precision float than a fixed-point 64 bit [0,1] number.
- psychphysic 4y agoAh makes sense. I imagine depending one how you intend to use the numbers you need that precision at the steeper parts too.