6 ms·
Etaoin Shrdlu
- shaicoleman 5y agoETAOIN SHRDLU was the frequency counted manually from a corpus of 20,000 words in the 60's. The actual letter frequency is more like: ETAOIN SRHLDCU [1] 1. English Letter Frequency Counts: Mayzner Revisited - http://norvig.com/mayzner.html http://norvig.com/mayzner.html
- jameshart 5y agoETAOIN SHRDLU was the standard ordering on linotype keyboards from the 1880s, so it seems unlikely the corpus it was based on was analyzed in the 1960s. Norvig’s article doesn’t actually attribute ETAOIN SHRDLU to Mayzner’s study, which was more interested in developing statistical models for bigrams, n-grams, and letter positions. In fact it seems more likely to me that if Mayzner’s 20000 word corpus managed to match the ETAOIN SHRDLU sequence it might be because they actually used it to calibrate the corpus to ensure it was representative so that they had some faith in the n-gram analysis.
- rolph 5y agohttps://en.wikipedia.org/wiki/Letter_frequency#Relative_frequencies_of_letters_in_the_English_language https://en.wikipedia.org/wiki/Letter_frequency#Relative_freq... https://en.wikipedia.org/wiki/Al-Kindi https://en.wikipedia.org/wiki/Al-Kindi
- pfdietz 5y agoSF Author Fredric Brown published a story in 1942 titled "Etaoin Shrdlu". I believe he worked as a linotype operator at one point.
- LeoPanthera 5y agoThe documentary of the same name, which chronicles the last ever hot metal typeset edition of the New York Times, is fascinating and I highly recommend it. It's 30 minutes and you can watch it for free on Vimeo: https://vimeo.com/127605643 https://vimeo.com/127605643
- ulrikrasmussen 5y agoI did not think about the fact that lines were set in molten lead before! Did typesetters experience health issues from this?
- jameshart 5y agoYes - I’d heard of ‘hot metal printing’ for years before I actually saw a linotype in action and realized how literal it was. A linotype machine literally molds lead slugs into a ‘line o’ type’ then stacks them up to make a printable plate. It’s hot when it comes out because it was molten a moment earlier. And by lining up those plates next to one another you get columns. Newspaper layouts just naturally fall out of the capabilities of the technology. So much of what we take for granted in computer typography has direct lineage to mechanical linotype concepts - all web developers should have an understanding of how linotypes worked because the machine’s function defines the form of so much of what we expect of typographical layout.
- tempodox 5y agoThe same 1978 documentary on YouTube, without a need for logging in: https://www.youtube.com/watch?v=1MGjFKs9bnU https://www.youtube.com/watch?v=1MGjFKs9bnU
- LeoPanthera 5y agoIt should be noted that this version has considerably poorer video quality.
- tempodox 5y agoThanks for noting this. I couldn't compare since I have no Vimeo account.
- kingcharles 5y agoOh lord, the computerized solution still results in dozens of men having to cut out the computer print-outs with an xacto and glue them onto the pages by hand. WTF. All the technology they had in those roomfuls of computers and no-one had yet written the software to lay out the page too.
- jacobkg 5y agoI learned about this mnemonic as a kid for doing frequency analysis on simple substitution ciphers. (Also when I saw my first R rated movie I apparently quipped: “It should be fetaoin shrdlu”)
- aaronharnly 5y agoIt’s my go-to for Hangman or other letter-guessing games. Love the quip :)
- dang 5y agoSome past submissions. Others? Farewell, Etaoin Shrdlu - https://news.ycombinator.com/item?id=28464368 https://news.ycombinator.com/item?id=28464368 - Sept 2021 (1 comment) Farewell Etaoin Shrdlu (1978) [video] - https://news.ycombinator.com/item?id=23538028 https://news.ycombinator.com/item?id=23538028 - June 2020 (46 comments) 1978 – 'Farewell, Etaoin Shrdlu' - https://news.ycombinator.com/item?id=16907778 https://news.ycombinator.com/item?id=16907778 - April 2018 (2 comments) The last day of linotype at the NYT (1978) [video] - https://news.ycombinator.com/item?id=16904770 https://news.ycombinator.com/item?id=16904770 - April 2018 (65 comments) Farewell – ETAOIN SHRDLU (1978) - https://news.ycombinator.com/item?id=15806072 https://news.ycombinator.com/item?id=15806072 - Nov 2017 (1 comment) Etaoin shrdlu - https://news.ycombinator.com/item?id=9958143 https://news.ycombinator.com/item?id=9958143 - July 2015 (1 comment)
- gojomo 5y agoBut also, SHRDLU: https://en.wikipedia.org/wiki/SHRDLU https://en.wikipedia.org/wiki/SHRDLU
- emmanueloga_ 5y agoIn my case, I saw "Shrdulu" and "Zardulu" came to mind [1] :-). There's a fun podcast about them at Reply All [2]. 1: https://en.wikipedia.org/wiki/Zardulu https://en.wikipedia.org/wiki/Zardulu 2: https://gimletmedia.com/shows/reply-all/o2ho6j https://gimletmedia.com/shows/reply-all/o2ho6j
- robocat 5y agoThe image of the linotype keyboard is worth 1000 words: https://upload.wikimedia.org/wikipedia/commons/4/46/Linotype_keyboard_with_Star_Quadder_attachment.jpg https://upload.wikimedia.org/wikipedia/commons/4/46/Linotype... The ligature ff gets its own key! And em space and thin space too. Very cool.
- dhosek 5y agoAny character without its own key required manually inserting the appropriate mat in the line which was a time consuming process. You’ll notice if you look closely that there are keys for fi fo ffi and ffl as well. f was the Achilles heel of the Linotype machine. Because of the way it worked, it wasn’t possible for one character to overlap the next so even with the f ligatures, it was possible to get ugly combinations like fifty fifes. One 1920s design had f-ligatures available for most combinations of f+a letter but was incapable of being used to typeset Kafka or Afghanistan.
- Symbiote 5y agoI found on the Wikipedia page that "pi matrices" referred to all the gylphs that didn't have their own key, due to rare usage. Fractions, foreign letters, presumably £ for the American machine shown. https://en.wikipedia.org/wiki/Linotype_machine#Pi_matrices https://en.wikipedia.org/wiki/Linotype_machine#Pi_matrices
- alexjplant 5y agoSpeaking of alternative keyboard layouts, I'd love to keep a Blickensderfer [1] around the house and learn DHIATENSOR. Unfortunately it's one of several aspirational hobbies of mine that's a complete and total anachronism with zero utility (like learning Morse Code, running an SGI Indy, or building tube amps) that I can't justify spending time and money on :-/. [1] https://en.wikipedia.org/wiki/Blickensderfer_typewriter https://en.wikipedia.org/wiki/Blickensderfer_typewriter
- Taniwha 5y agoMy dad left school at 15 to support his family during the great depression, his dad was blind, he became a linotype operator. When he went off to war he survived in relative safely, always a few km behind the lines in an HQ company, only got shot at a few times. This was because he had a rare skill for a man at that time - he could type (on a typewriter as well as a lino machine). Skilled lino operators were very rare and were treated well they could quit, go travelling and always know they had a job to come back to. (Dad went to university under the NZ equivalent of the GI bill after the war and became an accountant - for the same newspaper).
- OliverJones 5y agoI saw a demo of one of these Linotype machines long ago. It totally fascinated my ten-year-old self. IIRC, I tried to get the operator to give me a line of type. He wouldn't -- something about lead being toxic.
- techbio 5y agoIn more recent letter frequency analysis[1] the letter C makes the cut. The distribution also reminds me of anomaly detection using Benford's Law[2]. Wikipedia provides equivalent strings for other languages[3]. [1]http://norvig.com/mayzner.html http://norvig.com/mayzner.html [2]https://en.m.wikipedia.org/wiki/Benford%27s_law https://en.m.wikipedia.org/wiki/Benford%27s_law [3]https://en.wikipedia.org/wiki/Letter_frequency https://en.wikipedia.org/wiki/Letter_frequency