3 ms·
As you point out, many of these features are dependent on how well they're handled by the application developer. If Unicode were "just" about rendering pre-made
by chipsy 11y ago
As you point out, many of these features are dependent on how well they're handled by the application developer. If Unicode were "just" about rendering pre-made glyphs consistently it would not be nearly so hard, but it aims to do more - sorting, capitalization, string length - and that's also why it tends to fall over in production systems. Nobody is ever going to get Unicode completely right, just a subset of it for the languages they've successfully localized.
The simplest character encoding you could hope to work with is something like a single-line calculator or vending machine display - fixed-width, no line breaks, just the Arabic numerals and maybe a decimal point, some mathematical symbols, or a limited English alphabet to display "INSERT CASH". Any featureset above that produces issues. Just line breaks alone are responsible for all sorts of strange behaviors.
I think it's a bit magical that we've managed to do so much with text given the starting situation. At each step - from early telegram encodings through the proliferation of emoji - the implementations had to codify a thing that was previously left open, develop rules around its use, etc. We've made language more systematic than it ever was in history, for the benefit of machines to parse and process it.
- ygra 11y agoUnicode is complex because language is complex. Before we had that complexity in Unicode there were a lot of languages and scripts that couldn't be represented accurately (or at all) in computers. Mixing scripts in one document was nigh impossible. I'm not sure that's a world we want back. It's funny though, how people are not even aware of the fact that different languages are different until they see something break with Unicode. Casing and collation rules have been language-specific before. It's just that before lots of software didn't even attempt to do it right. Again, a world I'd rather not have back again.
- frobozz 11y agoThe decimal mark requires some localisation (see https://en.wikipedia.org/wiki/Decimal_mark#Countries_using_Arabic_numerals_with_decimal_comma https://en.wikipedia.org/wiki/Decimal_mark#Countries_using_A...). Let's restrict the calculator to whole numbers only.