4 ms·
> carefully-thought out Unicode policies Like https://www.unicode.org/reports/tr39/tr39-24.html https://www.unicode.org/reports/tr39/tr39-24.html ? The phrase
by gnufx 5y ago
> carefully-thought out Unicode policies
Like https://www.unicode.org/reports/tr39/tr39-24.html https://www.unicode.org/reports/tr39/tr39-24.html ?
The phrase ‘It's not difficult’ is probably rarely applicable in the context of multilingual text — notice the possible homographs!
My simple-minded approach was to take the Unicode TR's list of "confusables" and make an Emacs display table indicating all the possible non-ASCII characters that could occur in a homograph sequence, assuming mainly ASCII text. But that is simple-minded, and you don't always want it on.
»¿ʇı̣ əsnqɐ ʇ,uɐɔ noʎ ɟı̣ ɓuı̣ɥʇʎuɐ sı̣ pooɓ ʇɐɥM« — anon
- jerf 5y agoYes. I don't mean that a full solution is not that hard. That's AI-hard in the limit. But it's not hard to detect most of the bad things. Most of the homographs are not right next to each other in Unicode.