3 ms·
This article confuses a bunch of things: Unicode is simply a mapping between code points and characters, characters are encoded with one of Unicode "transformat
by necovek 5y ago
This article confuses a bunch of things: Unicode is simply a mapping between code points and characters, characters are encoded with one of Unicode "transformations" like UTF-8 (most popular on Unix-like systems) and UTF-16 (derivative of a much simpler UCS-2, basis for Windows and Java I think).
And while there is a lot of complexity introduced with Unicode, and even a lot of ambiguity, it is a great boon for non-Latin languages (think even something simple like Cyrillic or Greek).
Basically, for most of the world which already dealt with this "shit" for the last 50 years (it's not just Latin1 and ASCII), Unicode is a huge improvement (maybe not emojis ;). I've been happily using it for the last 20 years.
And sure, a complex problem requires complex knowledge to solve. But a decent language (like Python 3) will know if character is alphanumeric in any language or not or if it is any of the multitude of whitespaces (even if not as simple as in SPC, LF, CR, TAB...