3 ms·
The Google NLP team congratulate themselves so hard for handling studied-to-death Japanese text processing problems like Shift-JIS vs Unicode, half-width vs. fu
by quant18 17y ago
The Google NLP team congratulate themselves so hard for handling studied-to-death Japanese text processing problems like Shift-JIS vs Unicode, half-width vs. full width kana, word boundary detection, and multiple readings for kanji? I wonder if they're ever going to try working on the languages of Ethiopia/Eritrea and their seventy different encodings for Ge'ez, crazy morphology, and almost complete lack of English bitexts ...
http://www.punchdown.org/rvb/papers/EriPaper3C.html http://www.punchdown.org/rvb/papers/EriPaper3C.html