3 ms·
Why is Unicode worried about having separate character sets? Modern computers have plenty of storage space. If someone enters a form with these characters how
by charcircuit 3y ago
Why is Unicode worried about having separate character sets? Modern computers have plenty of storage space.
If someone enters a form with these characters how can a site know what language to show it as. It makes no sense to work this way.
- bhawks 3y agoInitially there was a desire to use only 16 bits for all of Unicode. This would allow for only 65K characters - so space was at quite a premium. The jump from 8 bits to 16 bits effectively doubled memory costs and still wasn't enough to achieve its goal.
- charcircuit 3y agoThat was over 2 decades ago, they have had plenty of time to try and fix this.
- eviks 3y agoIt wasn't designed for modern computers, inefficiencies also show as processing overhead, not just storage overhead, and in general software bloat can overcome any hardware progress
- initplus 3y agoUnicode was originally designed with the dream of fitting everything into 16 bits. CJK unification was a controversial measure that enabled this, by combining "the same" characters together in Chinese, Japanese, and Korean. Microsoft (wchar), Sun (Java), Netscape (JS) and many others settled on a 16bit fixed width "Unicode" encoding (nowadays often labelled as UCS-2). Later it turned out that 16 bits wasn't enough anyway, but we are left with the UCS-2 mess regardless. UCS-2 and CJK unification are historical mistakes in the development of Unicode that we are stuck dealing with.
- whakim 3y agoStorage limitations from the 80's (as described by sibling comments) is one reason, but there's also another: which characters are considered their own graph (versus variants) is a somewhat fraught geopolitical issue, especially when China and Taiwan are on opposite sides of the argument. The final chapter of Yale professor Jing Tsu's Kingdom of Characters does a great job laying out how this manifests itself at meetings of Unicode working groups.