3 ms·
Rather than (indistinguishable?) 0 and -0, why not add back some magnitude in the positive direction? { -1, 0, 1, 2 } is most obvious, but it's not clear w
by schiffern 3y ago
Rather than (indistinguishable?) 0 and -0, why not add back some magnitude in the positive direction?
{ -1, 0, 1, 2 }
is most obvious, but it's not clear whether it's better or worse than
{ -1, 0, 1/2, 1 }
Maybe theoretically (if not architecturally) it would best to "split the difference" between the two and choose
{ -1, 0, 1/phi, phi }
or perhaps the more implementable
{ -1, 0, 1, 3 }
EDIT: Of course you can also go the other way, with
{ -1, 1 }
- dekhn 3y ago-0 is not indistinguishable from 0 in floating point math. Most ops return +0 and -0 can behave differently. I don't know of any examples where -0 is important for machine learning, though.