2 ms·
Does the entirety of Japan shun utf8?
by pavel_lishin 3y ago
Does the entirety of Japan shun utf8?
- koito17 3y agoMany Japanese websites have migrated from Shift-JIS to UTF-8, but this still ignores the fact that e.g. television captioning uses special characters[1] that are not found in UTF-8 or Shift-JIS. Windows itself has a habit of using its own Windows-932 encoding, which frequently causes problems in the Unix software I use. (e.g. Emacs fails at auto-detecting this format, and instructing Emacs to use Shift-JIS will result in decoding issues) [1] section 1.2 in https://www.fontucom.com/pdf/AFSARIBR-Map.pdf https://www.fontucom.com/pdf/AFSARIBR-Map.pdf
- cheeze 3y agoIf Emacs fails to do it correctly, end developers are screwed.
- koito17 3y agoWindows-932 is the text encoding I dread the most. I wish literally everything could use Unicode, but we're not quite there yet. There's a reason encoding-japanese[1] on NPM has nearly 1 million weekly downloads. Unfortunately, I have to use it in one of my React Native applications since the one of servers I speak to returns text encoded as Shift-JIS and Hermes does not implement JavaScript's TextDecoder API. Shift-JIS is marginally better than the Windows code page, but I'd really prefer UTF-8. [1] https://www.npmjs.com/package/encoding-japanese https://www.npmjs.com/package/encoding-japanese
- Dwedit 3y agoAll the television caption characters shown in that chart have a Unicode code-point defined, so they exist in UTF-8.
- lmm 3y agoMore or less. The proportion of Japanese websites that use Shift-JIS is actually increasing, for example. (It's true that the absolute number of Japanese websites using UTF-8 is increasing, but that's misleading - it's only due to the overall growth of the web).