22 ms·
How a comment on Hacker News led to 4½ new Unicode characters
- andrewclunn 10y agoᛈοοו
- smegel 10y ago> Ask the people behind your Operating System and those who design your favourite fonts to start supporting Unicode 9! Surely not every font has to create glyphs for every Unicode character...how does that work? Is there a kind of "fall-back" font for characters not implemented?
- Gracana 10y agoThere is exactly that! https://en.wikipedia.org/wiki/Fallback_font https://en.wikipedia.org/wiki/Fallback_font
- deleted 10y ago[deleted]
- abritinthebay 10y agoSort of. Font substitution is a thing in most operating systems. As long as one font on the system has those characters it should work. Not always true though, and can depend on the application using the right system calls for rendering text (for example).
- medgno 10y agoSystems have a way of finding fall-back fonts. At least on OS X (err, macOS) they will satisfy glyph requests in order from the font you specify, some built-in fonts, and then any fonts that have the required glyphs. Finally, a "last resort" font is used to fill in any remaining glyphs[1]. A result of this is that if you ask for a character such as "𓀴" (U+13034 EGYPTIAN HIEROGLYPH A044) in a monospace font, the symbol you get back can be variable width. [1]: https://en.wikipedia.org/wiki/Fallback_font https://en.wikipedia.org/wiki/Fallback_font
- pavanky 10y agoAnd I see a boxes (on linux)
- aarongolliver 10y agoSame on win10/chrome. Works on edge though.
- kalleboo 10y agoOn my Mac it gets displayed with "Noto Sans Egyptian Hieroglyhs" which appears to be included in the system (/Library/Application Support/Apple/Fonts/Language Support) but can be downloaded for other platforms from here https://www.google.com/get/noto/ https://www.google.com/get/noto/
- benkuykendall 10y agoThat's not an inherent problem with GNU/Linux. Shows up fine for me because I have "ttf-ancient-scripts" (https://aur.archlinux.org/packages/ttf-ancient-fonts/ https://aur.archlinux.org/packages/ttf-ancient-fonts/) installed.
- pcr0 10y agoI see a box with these two lines inside it: 013 034 OSX 10.11.4
- umanwizard 10y agoAh, so is that why emojis don't display correctly in vim? They spill out of the character's bounding box...
- legulere 10y agoThat sounds more like a problem of your terminal. The basic problem is that Unicode characters (which may consist of as many codepoints as you like) have varying width. For instance Chinese has characters that are displayed over a width of two normal monospace characters. See this hacker news post: https://news.ycombinator.com/item?id=10206380 https://news.ycombinator.com/item?id=10206380 So the problem with emojis is that they aren't really specified to be full width or half width characters: https://ianrenton.com/blog/adventures-in-emoji/ https://ianrenton.com/blog/adventures-in-emoji/
- johncolanduoni 10y agoThis isn't even possible for most font formats. There are over 100k assigned code points, but TTF and OTF both use unsigned 16-bit glyph indices, giving a maximum of 65,536 glyphs per font. Not all code points map to glyphs, but some glyphs are also not directly associated to code points (for example, some Unicode combining marks require separate glyphs in certain combinations).
- lifthrasiir 10y agoThere are some, and I have tried to make one myself [1] to learn OpenType and scripts. It is hard and takes much time and effort to get a good one (Noto fonts [2] are probably the closest font that covers the entire Unicode and looks great). I admit that it is still hard even when you don't have the looks-good requirement. [1] https://github.com/lifthrasiir/unison https://github.com/lifthrasiir/unison [2] https://www.google.com/get/noto/ https://www.google.com/get/noto/
- yuhong 10y agoI wonder when will Windows add support?
- krapp 10y agoI wonder if HN is going to complain about the frivolity and uselessness of these the way they incessantly complain about emoji every time a Unicode thread comes up?
- yingnansong 10y agoThanks for making the contribution :)
- c3t0 10y agoCongratulations! Following through all that work specially with a consortium of such significance is great feat of perseverance. Thank you for stepping up and making a difference.
- edent 10y agoThanks mate :-)
- hackuser 10y agoAs the story mentions regarding the off symbol (a circle), there are many visually identical code points that have different semantic meanings. But in this case, they added an additional semantic meaning to an existing code point. So which is it? Does each code point represent a visual image? A semantic meaning? Both? It depends? Something else? I've tried to decipher that on my own and only learned that the answer to these sorts of questions are complicated, because it's very complicated to represent all written human language via one set of rules. So I know some of the answers to my questions above, but I'm hoping someone with real expertise can provide the fundamental rules/policies - if there are any.
- mrb 10y ago"So which is it? Does each code point represent a visual image? A semantic meaning? Both? It depends? Something else?" Well the answer is clear: each code point represents one visual image, to which is associated one or more meanings.
- coddingtonbear 10y agoThat is not the compromise struck, though; there are even many Cyrillic glyphs that are visually identical to those in Latin, but assigned differing codepoints.
- jhanschoo 10y agoThere are multiple reasons for that, one of which is compatibility with previous encodings and standards. If a previous encoding Unicode wanted to be compatible with encoded these as different characters, Unicode needs these to have separate code points for them too.
- hvidgaard 10y agoThat is the surefire way to incorporate complexities from 2 different systems into 1.
- LELISOSKA 10y agomaybe there should be like a universal unicode for all the icons that apps might need that represent common functionality and they should be animated to represent an either on or off state for some of them. also top brand square logos should be added into the unicode as well. and then different forks/variations can be submitted for the unicode and be accepted if they are useful and good looking. also they should all be black and white and have the same theme/look similar. u like my idea?? :DD
- hunter2_ 10y agoSounds pretty awesome!
- mappu 10y agohttps://materialdesignicons.com/ https://materialdesignicons.com/ makes a font available with a reasonably large selection of brand and functionality icons, using unicode private ranges (also svg or whatever). I don't think i personally agree with brand logos in Unicode.
- Jaruzel 10y ago> I don't think i personally agree with brand logos in Unicode. Seconded, brands come and go, as do their logos, many large corporations have gone through several logo changes. Pan-Am is the main one that springs to mind (or it's because I've just re-watched Blade Runner AGAIN...)
- dingo_bat 10y ago>several logo changes So just change the font you use to render Unicode. The Unicode itself can remain the same.
- FuturePromise 10y agoHow about a symbol that means "Trigger Warning?"
- dang 10y agoPlease don't post unsubstantive comments here.
- GauntletWizard 10y agoI'm still waiting for a Unicode codepoint for Love Symbol #2 (aka The Artist Formerly Known as Prince). There are codepoints for dead Chinese emperors, there should be one for Prince.
- Jaruzel 10y agoIt actually exists as an official font file published by Prince himself: http://nymag.com/selectall/2016/04/princes-legendary-floppy-disk-symbol-font.html http://nymag.com/selectall/2016/04/princes-legendary-floppy-... I don't know the codepoint for it though. Does anyone (other than the guy mentioned in the article) actually have this 'Prince Font' ?
- scrollaway 10y agoThe article says it replaces capital P (U+0050).
- Jaruzel 10y agoOh yeah, missed that bit! Obvious really.
- yk 10y agoI already ranted about unicode earlier today, my main argument is, that unicode is what happens if everybody qualified thinks: "That's a great idea, of course you have to handle X and Y and Z and I just remember that I forgot to fill out several warranty cards." This blog post is a nice example, I have absolutely no idea how these new code points are supposed to look like, since I only spend an afternoon to implement the unicode best practices from the Arch wiki, instead of subscribing to some unicode standard mailing list. (Except the one symbol which was redefined to a symbol that does not carry the semantic meaning of "standby symbol" anywhere outside of the unicode standard.) In my opinion there are two ways forward, one burn the entire thing. Or alternatively, force the unicode committee to produce an authoritative and complete font, in triplicate, and in their own blood.
- detaro 10y agoWell, if you want to know what they can look like, the blogpost has images, an embedded webfont and links to the reference font for the new symbols. And AFAIK providing reference images that are freely usable is required for all new symbol proposals.
- yk 10y agoIt does not work on Firefox with noScript. (And as a matter of fact, prohibiting random blog posts from rendering unicode, executing complex numerical calculations on my graphics card or delivering exploits is kind of the purpose of noScript...)
- 10y ago
- bbcbasic 10y ago⏻ To The People!
- lacker 10y agoWill there just eventually be one emoji for each distinct concept?
- kalleboo 10y agoTime to just add Emoji as another CJK language https://en.wikipedia.org/wiki/CJK_Unified_Ideographs https://en.wikipedia.org/wiki/CJK_Unified_Ideographs
- peterburkimsher 10y agoCJK stands for Chinese (traditional and simplified), Japanese, and Korean. Adding Emoji would make it: Japanese, Oriental, Korean, and Emoji. It's a bad JOKE.
- idanga 10y agoTakes a character to make a character :P Well done.
- bsder 10y agoThe past tense of "lead" (rhymes with bead) is not also "lead". When did the word "led" disappear from the English language?
- malz 10y agoIt hasn't disappeared (Google Ngram viewer shows a consistent occurrence of "led" since 1800). It's just a common error due to (1) inconsistency with "read" (same spelling for present and past tense) and (2) the noun "lead" being pronounced "led".
- yorwba 10y agoTIL: I have consistently mispronounced "lead" (metal) like "lead" (verb) my whole life.
- dang 10y agoWe fixed it in the title above. Don't forget that we're fortunate enough to have a great many non-native English speakers here.
- bsder 10y agoThe "native" English speakers are actually some of the worst offenders. I want to strangle "reporters" who write articles for the NYT, Washington Post, etc. who get this wrong all the time.
- dclowd9901 10y agoUnicode symbols... seems like we should've developed them the way languages develop: start with the most important symbols, ones for food, water, shelter, danger, etc, then expanded them into the abstract mess they are today.
- rabboRubble 10y agoEmoji were not developed haphazardly. They evolved naturally in Japan, then were adopted by the rest of the world. That is why there are so many Asia / Japan themes in the standard emoji set. The problem is Westerners don't understand the Japanese emotion behind the symbol. The symbol for bookbag looks exactly like a Japanese school kid's backpack. It's why there is a kimono. Bamboo wind chimes. Tsunami. Shinkansen... I could go on and on. In some respect, they are getting jumbled up because of international pressures for the base emoji set to be stretched into a be-all for the global market. An example is Taco. There are tacos in Japan. They are hard to find and when you do find one, you definitely don't want to eat one there. Mexican food is one of the rare cuisines the Japanese don't do better.
- deleted 10y ago[deleted]
- Animats 10y agoBut why? The trend towards putting icons into Unicode may be a mistake. Unless it's a symbol one uses in a sentence, there's no real reason to have it in Unicode. Unicode should not be viewed as a standard clip art library.
- bbcbasic 10y agoఠ_ఠ don't say that
- sthatipamala 10y agoThe eyes in your emoticon are actually the letter 'ta' in Telugu, a regional Indian language.
- tlrobinson 10y agoಠ_ಠ
- acqq 10y agoWow, the Japanese really spend a lot of time inventing these combinations: http://japaneseemoticons.me/all-japanese-emoticons/ http://japaneseemoticons.me/all-japanese-emoticons/
- jasonszhao 10y agoIf I understand correctly, Unicode only provides the semantic meaning, not the actual rendering. The font provides information for how to render it. Am I right?
- valleyer 10y agoYes, though they provide guidance on how they should look, and in most cases, there is only one font on the system that has a glyph for some of these more esoteric code points, and it usually provides a reasonable representation.
- tangus 10y agoHow did the Unicode Consortium turn around. I remember 10 years ago they were refusing to add standard media icons because >The scope of the Unicode Standard (and ISO/IEC 10646) does not extend to encoding every symbol or sign that bears meaning in the world. >This list has been round and round and round on this -- regular as clockwork, about once a year, the topic comes up again. And I see no indication that the UTC or WG2 are any closer to concluding that bunches of icons should start being included in the character encoding standards simply on the basis of their being widespread and recognizable icons. >Where is the defensible line between "Fast Forward" and "Women's Restroom" or "Right Lane Merge Ahead" or "Danger Crocodiles No Swimming"? (http://www.unicode.org/mail-arch/unicode-ml/y2005-m08/0371.html http://www.unicode.org/mail-arch/unicode-ml/y2005-m08/0371.h...) Now it looks they add whatever somebody thinks of. I guess it's related to the liberation from the BMP.
- shakethemonkey 10y ago>The scope of the Unicode Standard (and ISO/IEC 10646) does not extend to encoding every symbol or sign that bears meaning in the world. Until Unicode has a half-star character, it won't even be able to encode the average newspaper.
- kens 10y agoSomebody should propose the half star (used in star ratings) to Unicode. Seriously.
- Bromskloss 10y agoAnd two thirds, and three fifths, …
- dagaci 10y agogood idea
- namaemuta 10y agoMultiply your rating system by 2 and you won't need half stars :)
- peterburkimsher 10y agoTIL that the SI units all have Unicode symbols. http://www.marathon-studios.com/unicode/categories/So/Other_Symbol http://www.marathon-studios.com/unicode/categories/So/Other_... If people actually used these, it would make searching text for formulae much easier. Wikipedia editors and academic publishers, please note. Also, there's no Unicode for screwdriver. Perhaps iFixit would like to campaign for that? Congratulations on getting the power symbols in! When @edent writes "Will update ... when I stop dancing", was it "I got the power"?
- legulere 10y agoThe SI ones are for use together with Chinese/Japanese/Korean to fit together with their square characters. I don't see how using them for anything else would have any use. I never searched for units when searching for formulas
- dalke 10y agoI didn't see special Unicode symbols for the SI units in the link you gave or in a more general search. I found no match for "ampere" which is the SI base unit for electric current, or for "candela", used for luminous intensity. BTW, just because a character exist doesn't mean it's the best choice for ordinary use. As https://en.wikipedia.org/wiki/%C3%85#Symbol_for_.C3.A5ngstr.C3.B6m https://en.wikipedia.org/wiki/%C3%85#Symbol_for_.C3.A5ngstr.... points out: > Unicode also has encoded U+212B Å ANGSTROM SIGN. However, that is canonically equivalent to the ordinary letter Å. The duplicate encoding at U+212B is due to round-trip mapping compatibility with an East-Asian character encoding, but is otherwise not to be used.
- bArray 10y agoTruly amamzing man! I was actually wondering about the electrical symbols for logic gates, such as AND, OR, NOR, XOR, NOT, etc. I would hope they were universally accepted by now and would help when writing books or describing logic. A quick Duck Duck search revealed nothing...?
- voltagex_ 10y agoDo you mean in Unicode or in general? https://en.wikipedia.org/wiki/Logic_gate#Symbols https://en.wikipedia.org/wiki/Logic_gate#Symbols
- bArray 10y agoUnicode? Of course they are well defined generally.
- nneonneo 10y agoElectrical symbols in general don't do so well when scaled down to the size of text. Plus, it is very uncommon to encounter the electrical gate symbols inline with text - usually the symbols are sitting in a separate circuit diagram. Nevertheless, Unicode does have all of the logical symbols from mathematics, which are pretty commonly understood: ∧∨¬⊕
- bArray 10y agoBefore Unicode made it so, when was there a need for an ice cream or a poo inline with the text? It's a way of expressing language.
- kens 10y agoThe success of the unicodepowersymbol proposal inspired me to suggest a couple characters to Unicode (the Bitcoin sign and IBM's group mark from 1960s mainframes, which were accepted). The point is that Unicode really is open to proposals from random people; you don't need to part of a big company to influence Unicode.
- PhasmaFelis 10y agoIt's really cool than these things can happen. Still, I can't help but feel like, in a couple of centuries, Unicode is gonna be a goddamn mess.
- akiselev 10y agoWhat isn't a huge goddamn mess after several centuries? If there's one thing we humans don't deal with well, it's entropy.
- ygra 10y agoHeck, Unicode is a mess already. But that's mostly because (a) language and scripts are messy, and (b) the original aim was to unify and encompass all existing character sets, and some of those were messy as well. While there was considerable uproar over Emoji and there still often is over yet another fifteen symbols that everyone thinks no one would ever need or use, the bulk of the Unicode character set is still scripts for human languages. And some of those are only relevant for a very small minority, say, archaeologists. But that's fine. There's enough space, we're nowhere near to running out and Unicode enabled all sorts of cool things in computing that simply were not possible before or only with awful hacks and workarounds.
- xvilka 10y agoWorld also need better support for BiDirectional text in every kind of software. Especially poor support in terminal emulators and console tools.
- WalterBright 10y agoWhere does adding new Unicode symbols stop?
- function_seven 10y agoWhen there are no more to add or the symbol space is full. Until then, no reason to halt it as far as I'm concerned.
- WalterBright 10y agoI always thought that phonetic spelling had a point. "Until it's full" reminds me of departments that feel they must spend their entire budget.
- scrollaway 10y agoThat... is a terrible mindset. When do we stop handing out IPv4s by the hundreds of thousands? "When we run out". When do we stop doing 120km/h? "When we run out of road". When do we stop spending money? "When we're flat out broke". (Note: I am not advocating for or against the unicode case, I'm making a point about the specific mindset used to justify this)
- function_seven 10y agoI phrased it rather crudely. I really meant "when there is no more to add". With the caveat that running out is the other option. I think the question represents an equally terrible mindset, "when do we stop?" How can I answer that, honestly? Is there a number? Or is it when a certain date has come and gone? How do we pick that number? Or that date? Why do we need to stop? I understand why we might want to rate-limit the adoption of new glyphs, but I don't see why we'd ever draw a line in the sand and say, "Ok, now it's frozen." Imagine if that had happened before the creation of the Euro as a currency.
- scrollaway 10y agoRight, that's a much better way of seeing it and I don't disagree.
- WalterBright 10y agoI always wondered what was wrong with the glyph "ON" to denote on.
- qbrass 10y agoIt makes it harder to find the "OFF" button when it's marked "ON"
- WalterBright 10y agoUse the glyph "OFF" for off. Seriously, equipment has been marked ON and OFF for a hundred years. Is there any evidence anyone was confused with this more than with O and | ?
- function_seven 10y agoPeople who don't speak English? https://en.m.wikipedia.org/wiki/Power_symbol https://en.m.wikipedia.org/wiki/Power_symbol
- qbrass 10y agoYou don't have to be able to read the word ON to recognize it as a symbol. "Circle next to zigzag-thing" is as good as circle with line sticking out of it.
- WalterBright 10y agoThere's also precedent. Continental Europe standardized on "STOP" on stop signs back in the 70's, even though no continental language has "stop" in it.
- merijnv 10y agoExcuse me? No continental European language has the word stop in it? You should probably learn more languages before making claims like that. Stop is a word in Dutch (the first recognisable use of the word I could find dates back to 1287). And German has stopf. I couldn't find a date for that, because my German isn't good enough to read their etymology dictionary, but it's source is Old High Germanic, so it's safe to say that stop has been around in continental Europe in Germanic languages since Medieval time at the very least. Edit: A quick further Google search reveals that Norwegian and Danish (and thus most likely Sweden too) have the variation "stoppe" derived from Low German. Seems a bit disingenuous to claim it was adopted despite "not being an existing word" if two languages use the exact rendering on the sign and 4 others use/have words that are so closely related that they have the same spelling, but 1 or 2 additional letters. Further edit: French apparently adopted the word stop from English...in 1792
- gcb0 10y agowas this a clever ploy from the awful-and-unusable-incident-management-system-as-a-service i have to use at my job whose logo is ⏻?
- rbanffy 10y agoCool. I'll add these (and the IBM-related symbols @kens mentioned, which are specially appropriate) to https://github.com/rbanffy/3270font https://github.com/rbanffy/3270font for the next release (this weekend, I think - still lots of Cyrillic cleanup to do in the develop branch).
- wooptoo 10y agoLegitimate question: Why is Unicode littered with all those useless symbols? I can see the reasoning behind the standard (or very common) symbols or things like emoji, but having every possible glyph in UTF8 seems like a horrible waste. What if we want to add new glyphs in the next 10 years for emerging standards?
- onion2k 10y agohaving every possible glyph in UTF8 seems like a horrible waste A horrible waste of what? Unicode 9.0 encodes 128,172 characters, of a possible total 1,112,064 code points. The addressable space is 11.52% full. Clearly there's enough left to keep adding more and more characters for a really long time. If your complaint is that it's a waste of resources, time, etc - surely it's up to the people who are members of the consortium to decide how they want to spend their energy?
- Bromskloss 10y ago> Clearly there's enough left to keep adding more and more characters for a really long time. And then what? It's already 11% full.
- coldtea 10y agoSo? In this 11% it already covers almost all written languages in use and tons of dead ones. It also has lots of classic symbols, from math, book ornaments, standard typographic stuff (left arrow, etc.). So all the basics are covered. We could cover the rest 89% with variations of the turd emoticon and we'll still be perfectly fine.
- deleted 10y ago[deleted]
- marcosdumay 10y agoAnd then we expand it again, like we did at the earlier 2000's. UTF8 will support it by default, UTF16 will stay broken, UTF32 will break, but nobody uses the later.
- nabla9 10y agoAt some point, someone realizes that there is need to standardize fixed practical subset of Unicode that contains all essential symbols over the world so that all devices that comply with the standard can __actually__ interchange text in readable, printable and visually presentable form. It's nice to have catalogue of symbols and tight encoding for them, but full support of Unicode encoding has very little to do with support for Unicode in an application. 🇦 🇧 🇨 🇩 🇪 🇫 🇬 🇭 🇮 🇯 🇰 🇱 🇲 🇳 🇴 🇵 🇶 🇷 🇸 🇹 🇺 🇻 🇼 🇽 🇾 🇿.
- kozak 10y agoBasic Multilingual Plane?
- nabla9 10y agoYes, basically. I think we want to have normalization and other simplifications and restrictions to processing. What I have in mind is restricted standard subset bundle that makes it possible to send text that ends looking right in every device in the future. Imagine that you are developing wristband device and you can buy ASIC or FPGA chip module that eats grapheme clusters and spits out bitmap for the right glyph every time.
- gpderetta 10y agoEmoji are not in the BMP. Whether they are essential or not I'll leave it to you :)
- coldtea 10y agoWell, they're not essential either. In fact up to less than 5 years ago, there weren't anywhere except in some phones (and mostly Japanese phones at that).
- userbinator 10y agoWhether unintentionally or not, you've just illustrated why emoji aren't truly essential. But some characters not in the BMP I would consider very essential, like the various Asian characters that didn't fit into the BMP.
- shurcooL 10y agoNice! That looks like a long journey, so congrats on seeing it through and being successful! On a related note, the main character of my unfinished game [0] will be pleased about this. [0] https://github.com/shurcooL/eX0#readme https://github.com/shurcooL/eX0#readme
- VMG 10y agoHope pause/play/rewind etc come next: http://fontawesome.io/icons/#video-player http://fontawesome.io/icons/#video-player
- nomercy400 10y agoYou mean 0x23E9 to 0x23FA, just before these new power symbols? I only noticed them because the unicode power symbol site has an image of what comes before their symbols.
- VMG 10y agonice, TIL http://www.unicodemap.org/range/48/Miscellaneous_Technical/ http://www.unicodemap.org/range/48/Miscellaneous_Technical/
- anhtran 10y agoI read this because the title reminds me about the latest release of Steven Wilson.
- digi_owl 10y agoEmoji, the megapixels of messaging?
- EdiX 10y agoAnd yet still no klingon...
- WorldMaker 10y agoI've been saying for a while now that the proposed conlang block (for Klingon, Tolkien's Elvish scripts, et al) was shut down prior to expanding into the Astral Plane and it's past time to revisit that proposal seeking a good spot in the Astral Plane. Similar academic criteria used for encoding deceased and historic languages can be applied to conlang proposals.
- systemfreund 10y agoFrom the Unicode 9.0.0 announcement [0]: > Important symbol additions include: > 19 symbols for the new 4K TV standard I am wondering, why did they add symbols for a standard which will become obsolete eventually? [0]: http://unicode.org/versions/Unicode9.0.0/ http://unicode.org/versions/Unicode9.0.0/
- paler 10y agoFor the same reason that they also include symbols for many obsolete (dead) languages and writing systems, as well as (per a comment above) a character used by the 1959 IBM 1401 computer (https://github.com/shirriff/groupmark https://github.com/shirriff/groupmark). The need to be able to discuss a certain technology in writing does not disappear just because it is out of general use.
- Someone 10y agoThey have symbols for languages that _have_been_ obsolete for centuries, if not millennia. Also, if popular, these kinds of things tend to outlive their technology. For prime examples, look at http://graphemica.com/ http://graphemica.com/, http://graphemica.com/%F0%9F%96%AA http://graphemica.com/%F0%9F%96%AA, http://graphemica.com/%F0%9F%96%AB http://graphemica.com/%F0%9F%96%AB, and http://graphemica.com/%F0%9F%96%AC http://graphemica.com/%F0%9F%96%AC (to be fair, I think that is overdoing it)
- TorKlingberg 10y agoI found the proposal with the new symbols here: http://www.unicode.org/L2/L2015/15238-n4671.pdf http://www.unicode.org/L2/L2015/15238-n4671.pdf They were proposed by Japan, and intended for TV electronic program guide. If it makes you happier, one of the symbols is for 8K.
- singularity2001 10y agoI first thought they are the ones responsible for this 'character': ﷽ 65021 ﷽ FDFD ARABIC LIGATURE BISMILLAH AR-RAHMAN AR-RAHEEM http://graphemica.com/%EF%B7%BD http://graphemica.com/%EF%B7%BD
- piotrkubisa 10y agoI hope that ligatures will be more popularized than using characters like "½", because it is very difficult to find them in text with standard ASCII characters, i.e. in Firefox by typing 1/2 in quick find (ctrl+f).
- Pxtl 10y agoI'm always wierded out by that, because it implies we should support the full gamut of math - superscripted/subscripted text, large fractions, the text above and below the epsilon in discrete sums, etc.
- kps 10y ago½ ¼ ¾ are in Unicode because they're in ISO 8859. They're in ISO 8859 because they appeared on a fair number of typewriters and metal fonts.
- acqq 10y agoCan anybody see how the characters look like? Wouldn't it be good to have the pictures of all 4 and half? Some link? I see there was a proposal here in PDF: https://github.com/jloughry/Unicode/raw/master/power_symbol_proposal.pdf https://github.com/jloughry/Unicode/raw/master/power_symbol_... But there's a lot of glyphs there. What was accepted then? If the circle was reused, what are the remaining four?
- gerbilly 10y agoFor all the animals they have in unicode(rabbit, hamster, cow, ...) how come there is no squirrel?
- lsaferite 10y agoI don't think they have a gerbil either.
- jgalt212 10y agoHow long before we need a defusedunicode to protect users and programs from confusion and scams? https://pypi.python.org/pypi/defusedxml https://pypi.python.org/pypi/defusedxml
- jloughry 10y agoActually there is something like that in the internationalised DNS standards (that is, internet domain names that look like .xn--xyz-abc sometimes and .日本 other times.) There's a blacklist of certain Unicode characters that are disallowed in domain names because they resemble more commonly used characters. See https://en.wikipedia.org/wiki/IDN_homograph_attack https://en.wikipedia.org/wiki/IDN_homograph_attack
- mirekrusin 10y agoWould they consider "fuck you" (middle finger) character? I think it would be very useful and quite popular.
- shabbyrobe 10y agoThey already did! http://www.fileformat.info/info/unicode/char/1f595/index.htm http://www.fileformat.info/info/unicode/char/1f595/index.htm
- agumonkey 10y agoI'm a bit confused about Unicode. It was a repository of linguistic symbols, not raw symbols. More and more it looks like wingdings. Isn't this putting burden on font support and Text processing (what's the lexicographic order of such symbols, using the abstract name ?) ?
- gkya 10y agoThat's what happens when you put good things at the hands of WWW.
- wmil 10y agoThey want every symbol used in a document to have a unique encoding, so that you can change fonts without losing meaning. Fonts like wingdings are a horrible hack. The idea is one (complex) encoding that will represent the info until the end of time. It creates a lot of trouble, but it's still a good idea.
- thaumasiotes 10y agoTechnically, glyphs are supposed to meet some standards, like being shown in use in running text, before they can be added to unicode. It's not supposed to be a repository of every picture anyone ever dreamed up. The standards are not applied consistently. Even leaving emoji out of it, the chinese "character" 囍 never occurs in running text, but there it is in unicode.
- ximeng 10y agoI don't think it's true that 囍 never occurs in running text - it's used in company names which would be used in text. It would be odd not to have an encoding for such a common character.
- thaumasiotes 10y agoAll right, I spent some time trying to find the requirement. I did not find it, but my tentative conclusion is that it does not apply to chinese characters. FROM MEMORY, a while back there was an article on HN complaining that emoji seemed to magically bypass the requirements other characters needed to meet for inclusion in unicode, and that in fact they were commonly in violation. The taco symbol was called out as an example. I can no longer find this article, but it mentioned the running text requirement, and -- I believe -- specifically indicated that use in names does not count as use in running text. (For an idea of why that might be the case, check out http://tvtropes.org/pmwiki/pmwiki.php/Main/LuckyCharmsTitle http://tvtropes.org/pmwiki/pmwiki.php/Main/LuckyCharmsTitle .) HOWEVER, I was not even able to find, on the unicode web site, any discussion of a running text requirement at all, for any kind of symbol. Some example proposals do refer to "running text" by name, but they don't indicate why. The example proposal given for adding characters to an existing block ( http://std.dkuug.dk/jtc1/sc2/wg2/docs/n2934.pdf http://std.dkuug.dk/jtc1/sc2/wg2/docs/n2934.pdf , suggested as a prototype in http://www.unicode.org/faq/char_proposal.html http://www.unicode.org/faq/char_proposal.html ) does not mention "running text" at all, and doesn't appear to go to much trouble to document it, although some such documentation is given. The rough guidelines for character proposals at http://unicode.org/pending/proposals.html http://unicode.org/pending/proposals.html do not refer to "running text" at all, but they do suggest that, late in the process (specifically, on a proposal summary form, which is different from, and subsequent to, an actual proposal), "references to dictionaries and descriptive texts establishing authoritative information" are required. I conclude that the Unicode standard's preferred criterion for chinese character inclusion is "would an authoritative chinese dictionary include this character", and while the answer to that question for 囍 is not unambiguous -- a lot of dictionaries don't include it -- it's easy to imagine that some do. I would appreciate a pointer to the actual running text requirements, as well as what they are supposed to apply to, if anyone can provide that. > It would be odd not to have an encoding for such a common character. Outside of its use as a wedding decoration, which is plainly nonlinguistic, how common is it?
- DiabloD3 10y agoThe only problem I see is OSX/iOS, Windows, and Android don't ship with some universal, but shitty, font that has every single last glyph ever, always immediately updated to the new Unicode standard.
- ck2 10y agoGreat work but the sheer amount of unicode is getting crazy. Starting to think it should all just be svg
- acdha 10y agoHow would search work with SVG? What about support for screen readers or translation? Having standard symbols like this means that all of those are easily solved without needing something like an image classifier.
- deleted 10y ago[deleted]
- baby 10y agoI was wondering why they would have snowmen in the language. And then it occurred to me that maybe, since the unicode set has so much room for characters, that they were planning to allow cross-language communication through emoticons. Think about it, if you can represent anything human with emoticons. Then you can communicate through emoticons only! Maybe that's what the ancient Egyptians were hopping for?
- deleted 10y ago[deleted]
- pja 10y agoI got a change into Unicode 9.0 too! It was just a tweak to emoji characters to mark them all as East Asian Full Width instead of Narrow or Ambiguous so that they displayed correctly when using a fixed width font in a terminal console. This probably only matters if you like to use emoji filenames (you mad person), but it felt like a wart so I reported it & had a short back and forth with the chair of the emoji-related subcommittee which resulted in a proposal which was eventually accepted by the committee into Unicode 9.0. The committee were great: took my tiny bug report seriously, wrote huge long treatises to justify the change & eventually voted it into the standard. (This was pretty much my peak geek achievement of 2016 so far :) )
- rspeer 10y agoHoly crap I appreciate this change! I thought they'd never fix it because of compatibility. Thanks for the effort you put in. It's not that I use emoji filenames, it's that I deal with real-world natural language text all the time, including at the console. (In terms of compatibility, my text-justifying function is going to stop working correctly for the period of time between when gnome-terminal updates to Unicode 9 and when Python 3.x does. Still worth it.)
- pja 10y agoIf they get their unicode data from the same, OS supplied source that supplies the wcwidth() function (or be using wcwidth() themselves) a libc update should fix both, I think.
- rspeer 10y agoThey don't. Python's "unicodedata" module updates with the minor version of Python. This is good, actually, because the meaning of a string operation should be consistent when run on the same version of Python. (If only this applied to the "default encoding". The default encoding should be UTF-8, not whatever you get by asking the user's likely-misconfigured locale. As it is, you can't rely on the default encoding if you want your code to work consistently.)
- 10y ago
- pookeh 10y agoIMO, this is "3½" more Unicode characters than required.