3 ms·
The good news is that the Unicode consortium has a report on this issue, and the tables already exist for normalization and mapping of confusables to their ASCI
by jffry 5y ago
The good news is that the Unicode consortium has a report on this issue, and the tables already exist for normalization and mapping of confusables to their ASCII lookalikes: https://www.unicode.org/reports/tr39/ https://www.unicode.org/reports/tr39/
- Alir3z4 5y agoOh, that's nice. I guess I can use that next time time to work on the data cleaning for that model. Thanks.
- wanderingstan 5y agoAs I commented above: I built a Python library for finding strings obfuscated this way. Was critical when moderating our telegram channel before an ICO. https://github.com/wanderingstan/Confusables https://github.com/wanderingstan/Confusables E.g. "𝓗℮𝐥1೦" would match "Hello"