4 ms·
It's not just the variable byte length that causes an issue, in some ways that's the easiest part of the problem. You also have to deal with code points that mo
by degamad 1y ago
It's not just the variable byte length that causes an issue, in some ways that's the easiest part of the problem. You also have to deal with code points that modify other code points, rather than being characters themselves. That's a huge part of the problem.
- amake 1y agoThat has nothing to do with UTF-8; that's a Unicode issue, and one that's entirely unescapable if you are the Unicode Consortium and your goal is to be compatible with all legacy charsets.
- bawolff 1y agoThat goes all the way back to the beginning Even ascii used to use "overstriking" where the backspace character was treated as a joiner character to put accents above letters.
- degamad 1y agoAgreed, we just conveniently forget about those when speaking about how complex Unicode is.