3 ms·
Plus while UTF-32 is currently defined as equivalent UCS-4, the surrogate pairs tricks of UTF-8/UTF-16 are still theoretically possible even if they don't curre
by WorldMaker 8y ago
Plus while UTF-32 is currently defined as equivalent UCS-4, the surrogate pairs tricks of UTF-8/UTF-16 are still theoretically possible even if they don't currently encode anything. Not that we have a reason today to expect there to be a plane bigger than the Astral Plane, but in the 90s no one expected the Astral Plane to open up. Anyone picking UCS-4 today and pretending its UTF-32 but not prepared to handle surrogate pairs for the Currently Imaginary Plane beyond, is potentially making the exact same mistakes of UCS-2 early adopters and will have the same UTF-16/WTF-16 headaches should that day arrive.
- cryptonector 8y agoI expect UTF-16 to die eventually and let us have more than 21 bits of codepoints, but we'll never ever need even 30 bits, let alone 32 bits, of codepoints. I have to imagine that you're just jesting :0
- WorldMaker 8y agoIt's not entirely a jest, but it is funny to think about. The question will be then, as it has been every time before: what do we mean by "Universal" in Unicode? One very obvious jest is that at the current rate of emoji expansion it may be inevitable to open up the next plane just for emoji. Less of a jest is that there's always more symbols to encode. We've been a wonderfully creative species, and we're still rediscovering old written languages and discovering new bits of physics and math that can benefit from new symbols. We've got tons of interesting fictional language encodings to consider that are currently not likely to be encoded in Unicode today because they are locked in that struggle between the needs of Academia, the interests the Enthusiasts, and the money/complications of Intellectual Property laws. (Klingon, Tolkien's Elvish languages, D'ni, Timelord Sigils, etc.) But if those seesaws tip towards enthusiasts or academia that changes quickly. Meanwhile, creative artists keep inventing new glyphs and languages to encode. That's just our one species on this planet. What if we discover more or get better at encoding existing non-human languages? Then we really get to test that "Universal" bit in the name, huh? (That's also obviously a bit of jest, but an interesting sci-fi hope/yearning there, too. It would be nice to encode some non-human languages for a change.) So, all of the above, based on current assumptions (emojis will slow down, IP law remains vicious, Fermi's Paradox won't been solved in our lifetimes, etc) may still be unlikely to push us past the Astral Plane, but that doesn't make it silly to assume that we may never need to open the next plane.
- cryptonector 8y agoThere's always more glyphs to encode, but I think it will be a long time before we reach hundreds of millions of glyphs, even if we assigned codepoints to every fictional script and every glyph used in dead scripts, and every variation used in medieval and ancient times, and every future new emoticon or glyph for new scripts or fashionable things. Remember, you need a fairly large number of users for each glyph, otherwise there's no point. We're not going to have per-person glyphs, as no one could understand enough of them for them to be useful. There aren't going to be too many new scripts with users in just the hundreds of thousands, or low single-digits millions. However, if that's wrong, if population gets large enough and regional scripts become a thing... then yeah, we'd run out, but let's hope not -- Unicode is complex enough as it is.
- WorldMaker 8y ago> Remember, you need a fairly large number of users for each glyph, otherwise there's no point. You are forgetting scripts like Linear A and Linear B which Unicode encodes despite only being of use to a few dozen academics or so at a time, and a few dozen (if that) or so (very) historic documents and maybe hundreds of academic papers over time. Popularity/usage isn't a determiner for Unicode encoding of a script. There are plenty of good reasons to encode low usage scripts and glyphs, if they help people communicate when they are used. But yes, I agree that it is probably a long while until the Astral Plane runs out, even encoding every small academically interesting thing along the way. I just don't feel we can discount the possibility that the Astral Plane won't be the last plane simply because we can't imagine today what the "Imaginary Plane" would even contain.
- cryptonector 8y agoI'm not forgetting those or any other historical scripts. I mentioned those. My comment about the number of users of glyphs was in the context of future new glyphs. The supply of old glyphs is pretty limited, so it's easy to accept them all even if the number of users is minute :)
- ubernostrum 8y ago