3 ms·
> "double width romaji" The double-width latin characters are the bane of every data analysis using Asian data. It's a roll of the dice whether any given Lati
by Pxtl 13y ago
> "double width romaji"
The double-width latin characters are the bane of every data analysis using Asian data. It's a roll of the dice whether any given Latin character will be in typical ASCII form or double-width form.
I'm sure there's some "seriously insensitive character comparison" library out there, but it's not built into my SQL server's "LIKE" operator, that's for sure.
- rspeer 13y agoThe seriously insensitive character comparison you're looking for is NFKC normalization (see http://en.wikipedia.org/wiki/Unicode_equivalence http://en.wikipedia.org/wiki/Unicode_equivalence). You would probably be able to normalize all your strings before putting them into your database. You'd lose no functionality unless at some point later you really did need to distinguish "C" from "C".