4 ms·
Obviously for any 32 bit value there’s only 2^32 possible values. So logically, a better number format is all about the distribution of values and reducing redu
by jchw 7y ago
Obviously for any 32 bit value there’s only 2^32 possible values. So logically, a better number format is all about the distribution of values and reducing redundancy.
It sounds like the basic idea here is that rather than a fixed amount of significant figures, you get more precision in the middle. Meanwhile, you can also get larger exponents. Is that right?
- jacobolus 7y agoThe ideas are (1) gradual instead of hard overflow [IEEE floats do gradual underflow via denormals], (2) crowding representable numbers more precisely around 1 while letting very large or very small numbers get less and less precise, vs. floating point which (except for denormals) is scale free within its range, (3) making a format which can be extended by just adding bits without new definitions, so that you can get more or less precise numbers as needed by just adding zeros or truncating, (4) a it more uniform logic for basic arithmetic with fewer edge cases. It's a bit sad that many of the creator’s claims are exaggerated and his examples cherry-picked though.
- deleted 7y ago[deleted]
- FabHK 7y ago> floating point which (except for denormals) is scale free within its range Presumably that's what you mean by scale free, but let's spell it out: It's denser around 0, then has uniform density between, say, 1/8 and 1/4, half that density between 1/4 and 1/2, half that between 1/2 and 1, half that between 1 and 2, etc. etc. If x = 1.0e22, you can add a million and it's still the same.
- hinkley 7y agoI recall in some of these earlier conversations, people pointing out that there are game engines where they invert some of their calculations to prevent artifacts caused by loss of significant figures with certain numbers.
- nraynaud 7y agoI agree with your analysis, think utf-8 on ieee754’s exponent.
- deleted 7y ago[deleted]
- dnautics 7y agothat's the general idea. There is an additional tradeoff - error analysis in non-extreme (aka subnormal) cases is easier for IEEE than posits. The quire stuff has been thrown in there, too, because while we're boiling the ocean, we might as well encourage people to "do the right thing". think of the quire as a really large accumulator cache for things like matrix vector multiplication or tensor outer products, which I hear, AI uses a lot.
- xhgdvjky 7y agoI believe this has even fewer allowable states because there's more than one way to represent the same number
- vanderZwan 7y agoThere aren't. On top of that, look at all the ways to represent NaN with IEEE floats.