25 ms·
Uppestcase and Lowestcase Letters
- bckr 6y agoOkay, based on the introduction of the linked paper, this is brilliant. I have seen few if any texts like this one, which treat a fun + interesting + simple idea with fun language while also presenting it in the form of a research article. Do give this a chance EDIT: I forgot what day it is. I really like the idea though and I think with a little more work it could really deliver
- jawns 6y agoIt reminds me a little bit of "Gödel, Escher, Bach" in terms of its playfulness.
- ronsor 6y agoTom does this sort of stuff regardless of whether it's 4/1 or not.
- deleted 6y ago[deleted]
- dhosek 6y agoThere's The Journal of Irreproducible Results. Not sure if it's still in publication though. Their website appears to be down/broken.
- alisonkisk 6y agoThats one side of the schism with the more popular Annals of Improbable Research. https://www.improbable.com/ https://www.improbable.com/
- dhosek 6y agoAh, that's the one that I really wanted. Thanks.
- bbischof 6y agoMy favorite line in this wonderful paper is: The database is just filled with garbage that is unusable for this project: Fonts that are completely illegible, fonts that are missing most of their characters, fonts with millions of control points, Comic Sans MS, fonts where every glyph is a drawing of a train, fonts where everything is fine except that just the lowercase r has a width of MAX INT, and so on.
- kebman 6y ago07:48 “Comic Sands; so called because the letters look like little droppings of sand, or something. And they are kind of aesthetic. We could consider this an improvement.”
- isoprophlex 6y agoThe linked paper is a wonderful read indeed! This guy is the Terry Pratchett of home-grown deep learning libraries... So I did that and let it run for a month. Actually I had to start over several times with different parameters and initialization weights because it would get stuck (Figure 11) right away or as soon as I looked away from the computer. I prayed to the dark wizard of hyperparameter tuning until he smiled upon my initial conditions, knowing that some- where he was adding another tick-mark next to my name in a tidy but ultimately terrifying Moleskine notebook that he bought on a whim in the Norman Y. Mineta San Jose International Airport on a business trip, and still feels was overpriced for what it is.
- matsemann 6y agoThe conference "FUN with algorithms" consists mostly if these kind of things. CS done on toy problems or other things making the papers a bit out of the ordinary (but still real science). Not presented in quite the same quirky way, though. https://drops.dagstuhl.de/portals/lipics/index.php?semnr=16069 https://drops.dagstuhl.de/portals/lipics/index.php?semnr=160...
- ygaitonde 6y agoI really can't think of a better technical YouTuber than tom7
- mohn 6y agoI would like to recommend Ben Krasnow of Applied Science[0]. His videos are more physics/chemistry/electronics, but they're both great YouTubers. [0] https://www.youtube.com/user/bkraz333 https://www.youtube.com/user/bkraz333
- lifthrasiir 6y agoMaybe try Ben Eater [1] out? [1] https://www.youtube.com/channel/UCS0N5baNlQWJCUrhCEo8WlA https://www.youtube.com/channel/UCS0N5baNlQWJCUrhCEo8WlA
- Causality1 6y agoThis was very obviously inspired by Randall Munroe's "capital numbers" comic and I find the lack of acknowledgement disappointing. https://www.xkcd.com/2206/ https://www.xkcd.com/2206/
- c3534l 6y agoI had this same idea when I was 7. Its just not a unique thought. However, it is interesting that the actual glyphs used are somewhat similar.
- alanbernstein 6y agoWell there is a sort of catch-all acknowledgement at least: > Probably someone already had this idea and did it before I was even born
- dhosek 6y agoArguably, lining figures are uppercase numbers and old-style figures are lowercase numbers. Certainly, the former work better in an all-caps setting than the latter, and the latter in mixed-case typesetting than the former. I used to set Canadian and British postcodes, which are mixes of letters and numbers using small caps and old-style figures when I printed mailing labels for the magazine I published in the 90s.
- Balgair 6y agoA real shame that he didn't put in the numbers to see what their capitals may have been
- ashertrockman 6y agoSIGBOVIK is proud to have published this groundbreaking work in its 2021 proceedings, which were released today. Also, check out the author's video: https://youtu.be/HLRdruqQfRk https://youtu.be/HLRdruqQfRk For more non-serious research that is often executed seriously, see: http://sigbovik.org http://sigbovik.org
- euske 6y agoFun fact (not fabricated BECAUSE IT'S APRIL 2ND OVER HERE): Japanese alphabets (kana) doesn't have a concept of upper/lower cases. There are two different types of kanas (round ones and square ones) but they are kind of equal in terms of strength/stress so they can't be used to express anger. People on 2-Channel forum (Japan's 4chan, basically) came up with a brilliant idea, which is to insert a space between each letter so that it looks a bit wider and has an extra oomph. Example: - normal: 今日はいい天気だね。 (it's a fine day, isn't it.) - angry: 今 日 は い い 天 気 だ ね 。 (IT'S A F*KING NICE DAY ISN'T IT)
- xmprt 6y agoThe only difference I see is in the kerning of the letters.
- jagged-chisel 6y agoyes. that's pretty much what GP said.
- wpearse 6y agoLet’s be honest... that’s exactly what GP said ;)
- totetsu 6y agokana's uppercase potential exists out there somewhere in latent space
- nullsense 6y agoThey do have half width versions though that are used when typing sometimes あ -> ぁ like if you want to indicate stretching vowel sounds out for emphasis.
- aviraldg 6y agoIsn't Katakana (for words that would normally be written with Hiragana or Kanji) also used sometimes to indicate emphasis? https://japanese.stackexchange.com/a/5314/31389 https://japanese.stackexchange.com/a/5314/31389
- bla3 6y agoIf you haven't seen tom7's youtube channel: Every single video at https://www.youtube.com/c/suckerpinch/videos https://www.youtube.com/c/suckerpinch/videos is a treat. Mind-bending, deeply funny, and amazingly work-intensive.
- xmprt 6y agoHis video on anagraphs is interesting (https://www.youtube.com/watch?v=qTBAW-Eh0tM https://www.youtube.com/watch?v=qTBAW-Eh0tM) especially if watched alongside his followup video proving that generalized kerning is an undecidable problem (https://www.youtube.com/watch?v=8_npHZbe3qM https://www.youtube.com/watch?v=8_npHZbe3qM)
- nonbirithm 6y agoTom7 will probably be the only person ever to bring up strange loops as part of a self-referential narrative for reverse engineering an NES and programming a slideshow presentation with the diagrams of that reverse engineering... on the NES itself.
- draw_down 6y agoThat was one of my favorite talks I’ve ever seen. I was really pleased to see this today because I was just thinking of the NES talk the other day and wondering what tom7 was up to.
- kibwen 6y agoSeconded, thirded, and fourthed. My favorite is "NaN Gates and Flip FLOPS", where he dismisses 0 and 1 as being too ugly to be the foundation of all computation and reinvents computing via the beauty of rational numbers, which is to say, the horror of IEEE754 floating point (along with a working hardware implementation!): https://www.youtube.com/watch?v=5TFDG-y-EHs https://www.youtube.com/watch?v=5TFDG-y-EHs
- mmastrac 6y agoI still keep Tom's old fonts around on my computer for various purposes. They have a real character that I haven't found in other fonts: http://fonts.tom7.com/ http://fonts.tom7.com/ It would be interesting to see if AI could be used to fill in some of the gaps in the fonts - ie: numbers for his Angstrom font (https://www.dafont.com/angstrom.font https://www.dafont.com/angstrom.font)
- fouc 6y agoWhich font do you use for development? ;)
- lunixbochs 6y agoSomething like mixup augmentation might work here as well for training - blend two SDFs and say "this is 20% A and 80% B". Someone could also train a model that given some glyphs of a font predicts the rest of the glyphs. Then we can do weird things like give it glyphs from multiple fonts as input to make a hybrid font.
- efskap 6y agoPersonally I'm curious about training a model to predict Cyrillic or Greek letterforms from Latin ones to boost multilingual coverage. I'm sure there are some learnable relationships there like Я <=> R or И <=> H.
- lunixbochs 6y agoVery interesting! Well, I'm playing with the concept a bit now. Currently writing a skia client to generate glyph SDFs as images so I can just use pytorch.
- wwwwewwww 6y agoI can't tell the relationship in your example. Do you mean relationship in terms of appearance or pronunciation? Я maps to "ya" sound in Russian, И is "ee" and Н is "N" in Russian and "ee" in modern Greek but in ancient Greek it's something like "e" in "bed" in American English.
- deleted 6y ago[deleted]
- hardmath123 6y agoSee also: "Words that do Handstands" (2019), where similar tricks are used to hallucinate an ambigram font! https://news.ycombinator.com/item?id=20820036 https://news.ycombinator.com/item?id=20820036 http://hardmath123.github.io/ambigrams.html http://hardmath123.github.io/ambigrams.html
- Pxtl 6y agoOh gosh I just watched the YouTube video and laughed until I hurt.
- moralestapia 6y agoWhat a great idea and a fun read! For an April fool's gag this is a truly remarkable work, kudos to the author!
- graderjs 6y agoThe questions no one one needed to be answered... This guy answers them so ... completely
- rrmm 6y agoThis is pretty much my exact experience in doing AI/ML research.
- sn41 6y agoI wonder why we still have capital letters. I understand that Latin had more angular letters to inscribe on marble, compared to the more rounded lower case letters for day-to-day writing. Now that we have the technology to do rounded inscription, why hang on to this outmoded notation? The simplicity of the Latin alphabet is unnecessarily complicated by the presence of capital letters. This is not as absurd as it sounds. After all, over the centuries, we have introduced punctuation to make it easier to read, unlike classical writing [1]. Why not carry through with remaining reforms? [1] https://en.wikipedia.org/wiki/Scriptio_continua https://en.wikipedia.org/wiki/Scriptio_continua
- m463 6y agoWhy not upper and lowercase numbers? Could emphasize cheap or expensive in a price. :)
- TheCoreh 6y agoLowercase numbers actually exist: https://en.wikipedia.org/wiki/Text_figures https://en.wikipedia.org/wiki/Text_figures
- hakfoo 6y agoI always imagined a writing system that used uppercase/lowercase to be "before and after a decmial point" without an explicit decimal. Like how some advertising material renders "$499.99" as 499 in a large size, followed by 99 in a smaller, often superscript style, and no discrete decimal.
- Talanes 6y agoI think you have it backwards, it was technology rendering the difference between the two obsolete that brought capitalization about. Latin just used one script or the other depending on use-case, it was when we had printing presses that we started to start codifying rules for how to mix the two scripts into one large character set.
- nullsense 6y agoNeed them for password strength
- isaacimagine 6y agoThis is incredible! I wonder what would happen if we threw more GPUs at it.
- tempodox 6y agoOut-of-fashion warning: tom7 uses Subversion, not git. How subversive. He really must belong to the institute for computational heresy. I press shift to reduce conflict all the time and I still feel conflicted.
- meken 6y agoAmazing video. My only suggestion for improvement for the modeling is in the part where you tried to find the "ideal" letters for the model. Instead of sampling generated random bitmaps and ranking those, you could instead initialize the inputs to random continuous values, then optimize the output score for the desired letter with respect to the random input (with your fixed model). Indeed, this is how people get those trippy dog images you've probably seen. Anyway, this video was just so good. I'm amazed.
- at_a_remove 6y agoI was wondering why not model letters as an additive series of strokes, just as we write with a pen, then evaluate the results.
- OscarCunningham 6y agoCould we use similar techniques to find the middlecase letters?
- nullsense 6y agoThat probably requires a middle-out approach.
- koliber 6y agoWe finally have someone here asking the important questions.
- CRConrad 6y agoToo narrow a use case: Will only work on middle-endian processors.
- Balgair 6y agoWell, if we can, are we then now in a situation where the 'step' of 'cases' is no longer an integer sequence? That is to say, that the cases are fractional? Like, if middlecase is 0.5, then can we apply the middlecase operation again and get 0.25/0.75? As applying cases is then just 'addition', then you can likely get the 'multiplication' and 'divisions' of the cases as applied. 'Exponentials' are just around the corner too. Is that is the situation, that we can now get transcendental cases. The 'pi' case, or the 'e' case, pick your favorite transcendental. More interestingly, you can then pull out the imaginary case, using Euler. e^(i*pi) = -1. Maybe that the lower-er case is just the 'e' case to the power of the 'pi' case times the 'i' case. Whatever those operations may mean. Of course, one you're at the imaginary cases, you might as well step up into derivatives and integrals, it's just curiosity after all. Then you'll be doing partial derivatives and then Lagrangians. Eigencase-ing comes next, and then Maxwell's equations in case format. 'Del'ing your cases should be a real trip. After only a bit of puzzling, you're doing quantum mechanics operations with your cases, because why not? Case-ing operations have a fruitful future for any mathematician, it seems.
- OscarCunningham 6y agoHmmm. I wonder if you can do backprop on exp(f) as efficiently as f? Then once you've learnt exp(f) you can just use exp(tf) to transform smoothly from one to the other.
- Smithalicious 6y agoI read the title as "upper caste" and "lower caste" and imagined what a caste system of letters would look like
- kebman 6y agoWhen the lockdown was extended by another year... xD
- tomgp 6y agoYou see that bit at the start of the video where tom7 presses the capslock key, then types a letter, then presses the capslock key again? I worked with a designer (posessed of two hands and no visible impairments) who actually typed like that. Working alongside him was an excellent lesson in patience.
- jrib 6y agoHave a programmer friend who does the same. At first it really blew my mind and I couldn't tell if he was serious. But he's a great coder and had loss of successful projects. It's just the way he learned and it doesn't seem limiting or annoying to him.
- jack_pp 6y agoI chuckled too but then I thought about it and.. it might be slightly slower but will probably be better for your hands long term since hitting shift you have to twist your hand awkwardly
- caslon 6y ago...what? I just checked on three different keyboards to make sure, but...no. Shift overlaps with A for a reason; you shouldn't be twisting your hand if you're using proper typing technique.
- jack_pp 6y agoon my laptop the shift is smaller than the caps-lock, about 2/3 the size of the caps-lock.
- BlueTemplar 6y agoWe're talking about 19th century typewriters here...
- unfunco 6y agoI did that up until about 5 years ago, and I've been a professional software engineer for 13 years or so, and programming longer than that. I had to remove the caps-lock key from my keyboard to force the behaviour out of my muscle memory. Now though, I have the opposite bad habit, if I need to write a long string of uppercase letters, I don't turn on caps-lock, I instead keep my left little finger pressed on the shift key.
- high_byte 6y agocan't believe I watched the whole video
- numToStr 6y agoThat was trippy.
- etaioinshrdlu 6y agoA different type of model like pix2pix, or anything raster based, not point-based might produce better looking fonts.
- koliber 6y agoThis is the most brilliant thing I've watched in a long time. I love the various ways Tom took this. His sense of humor, obscure references, and ability to tell a good story are outstanding. I also started watching the other videos and they're just as good. Tom, if you are reading this, I am curious what a capital smiley face emoji looks like. Or the capitalest. What does nirvana look like in a twittable small yellow circle? Or a lowercase one. Or lowestcase one. What is the graphic depiction of the pit of despair. You got me thinking. Sure, emojis are in color. But could you make them black and white? Or apply the transform to each color channel independently. I'm convinced there is a way, and if there is anyone who can find it, it is you. And if you do go this way, why stop at emojis? The world needs to know what a capital Mona Lisa looks like. Or the capitalest. I think you're on the path to general artificial intelligence here. iA.
- BlueTemplar 6y agoEmojis have a much more letter-like non-color fallback.
- qwertox 6y ago10 out of 10 for style and execution.
- rendall 6y agoI watched that whole video and now I'm questioning the life choices that led me here
- rmetzler 6y agoI laughed when it came to the part where he 3d-printed the uppestcase letter and described as "not bad, maybe a 2.5 on the Bristol stool scale".
- ohuf 6y agoTake my uppestvote and Happy Easter for a while, Sir!
- ant6n 6y agoWould it help to generate a bunch of (small) rotations, translations and scalings for every input/output character pair and train with that?
- jameshart 6y agoI love the concept and execution but it really is so sad that the results weren’t more compelling. I do wonder whether the problem is that training on multiple fonts just doesn’t actually add more data points to the dataset. Fundamentally, you’re going to get a model that knows how to uppercase or lowercase each canonical Latin letter. This model might actually be quite good at generating appropriate lowercase forms for a font given the uppercase glyphs, but it’s not learning an abstract concept of ‘lowercaseness’. Instead of extending the training set with more fonts, the only real source of additional training data would be more alphabets. Cyrillic and Greek both have case systems so just adding those would have more than doubled the number of training cases - I think the trick would be to start from the Unicode case mapping tables to generate your example data, to give your model more variety of upper/lowercase pairs to get its teeth into and really make it possible to ask it to uppercase an arbitrary letter form.
- gwern 6y agoThe approach he used didn't really make sense. I get the impression Tom is so dedicated to his old custom hackedup NN framework that he tailors the approach to what he could easily do in it. If you asked someone else, "I want to automatically turn characters into 'more uppercase' or 'more lowercase' versions, and it has to involve neural networks; what do?", they would say something like "Easy enough! dump character maps into a standard StyleGAN2-ADA, train for a few days, then find the latent direction corresponding to uppercasing & lowercasing, and edit whatever font you please." (People have been generating fonts with RNNs or GANs for ages.) You could do this over a week or so, the tooling has gotten pretty easy to use. And if you asked someone on the cutting-edge, they'd suggesting using OA CLIP through Aleph/BigSleep/etc to automatically edit images using a text input prompt of "a lowercase letter" or "an uppercase letter", or one of the hybrids like StyleCLIP https://github.com/orpatashnik/StyleCLIP https://github.com/orpatashnik/StyleCLIP . This approach might take all of an hour or two (but results probably would be worse).
- diplodocusaur 6y agoThis is a really fun project, no doubt, but I keep seeing stuff about fonts on HN. I was wondering why it is that HN likes fonts? What is it about them that makes them HN-interesting?
- mixedmath 6y ago> It does genuinely matter that a designer should take trouble and take delight in his choice of typefaces. The trouble and delight are taken not merely "for art's sake" but for the sake of something so subtly and intimitely connected with all that is human that it can be described by no other phrase than "the humanities". If "the tone of voice" of a typeface does not count, then nothing counts that distinguishes man from the other animals. The twinkle that softens a rebuke; the martyr's super-logic and the child's intuition; the fact that a fragment of moss can pull back into the memory a whole forest --- these are proofs that there really is reality in the imponderable, and that not only notation but connotation is part of the proper study of mankind. - William Zinsser Zinsser was actually talking about writers here. And it might be a bit hyperbolic, sure. But I think the fact is that people who love to program spend a lot of time staring at words, and given a chance they'll take interest in the clothes that words wear.
- diplodocusaur 6y agoHuh. That makes sense from a frequency of exposure sense. It's just that I'd be interested in the main fonts that make practical sense for projects and not so much on the quest for the holy grail of fonts that makes all men fall to their knees in awe at its aesthetic perfection. Doesn't matter how pretty you write bad content, anyways.
- MPSimmons 6y agoFrom the paper (http://tom7.org/lowercase/lowercase.pdf http://tom7.org/lowercase/lowercase.pdf): ... fonts where everything is fine except that just the lowercase r has a width of MAX INT... Okay, I cannot imagine what the use of that font would be, but I really want to know.
- bombcar 6y agoMany fonts are designed for a single logo use - imagine a logo that is lowercase r with the rest of the name under the r.