3 ms·
Do "most non-English" languages have normalization issues? At least CJK users do not.
by netheril96 9y ago
Do "most non-English" languages have normalization issues? At least CJK users do not.
- rurban 9y agoActually Korean (Hangul) is the biggest user of NFD normalization, with very special logic. Hangul also has the only 2 still remaining identifier bugs in the unicode 9 database. HANGUL FILLER and HALFWIDTH HANGUL FILLER wrongly being valid ID_Cont, as such wrongly usable as identifier characters (such as in filenames). Almost every script but Latin-1 has TR31, TR36 and TR39 issues. http://www.unicode.org/reports/tr39/ http://www.unicode.org/reports/tr39/
- cryptonector 9y agoHangul has composed and decomposed forms, but only the decomposed forms are used as canonical, even in NFC. (Incidentally, NFC is closed to new compositions, though new compositions can be added to Unicode.)
- anonymoushn 9y agoIf you want to use characters like が, you will have normalization issues.
- cryptonector 9y agoEven English has things like "reëlect" instead of "reelect" and so on. http://www.newyorker.com/culture/culture-desk/the-curse-of-the-diaeresis http://www.newyorker.com/culture/culture-desk/the-curse-of-t...