3 ms·
How useful are -0 and 0? You could splurge on two bits per value which gives you { -1, -0, 0, 1 }
by dekhn 3y ago
How useful are -0 and 0? You could splurge on two bits per value which gives you { -1, -0, 0, 1 }
- ant6n 3y ago3^5=243. so use a byte to represent a vector of 5 ternary values, leaving some possible signaling values.
- schiffern 3y agoRather than (indistinguishable?) 0 and -0, why not add back some magnitude in the positive direction? { -1, 0, 1, 2 } is most obvious, but it's not clear whether it's better or worse than { -1, 0, 1/2, 1 } Maybe theoretically (if not architecturally) it would best to "split the difference" between the two and choose { -1, 0, 1/phi, phi } or perhaps the more implementable { -1, 0, 1, 3 } EDIT: Of course you can also go the other way, with { -1, 1 }
- dekhn 3y ago-0 is not indistinguishable from 0 in floating point math. Most ops return +0 and -0 can behave differently. I don't know of any examples where -0 is important for machine learning, though.