44 ms·
The Yoda of Silicon Valley
- jhfdbkofdcho 8y agoExcept Donald Knuth is 7’ tall.
- sifoobar 8y agoJudge me by my size do you?
- time-domain0 8y agoSize me judge do you? ;)
- MordodeMaru 8y agoTaller than life.
- deleted 8y ago[deleted]
- time-domain0 8y agoI saw him in a parking lot at Stanford one time; I'd say 6' and change.
- fatjokes 8y agoThe article mentions he is 6'4
- deleted 8y ago[deleted]
- hudo 8y agoWhat NYT thinks devs are doing in Silicon Valley: AI and machine learning hacking in VR 3D What devs are really doing in Silicon Valley: debugging yet another "undefined is not an function"
- aleden 8y agoMost of programming is just moving shit around; not interesting mathematics like knuth has done
- m_fayer 8y agoWe're 21st century plumbers.
- aphextron 8y ago>We're 21st century plumbers. I tell people this all the time when they ask what I do. I've met quite a few master plumbers, and they are extremely intelligent technical geniuses for the most part. I'm completely convinced that I would have been one of them (or some other trade craft) if I were born 50 years ago.
- jamiek88 8y agoModest too, most of ‘em.
- time-domain0 8y ago- IT: Sanitation engineers - Developers: Hazmat engineers - CS: Civil engineers
- fouc 8y agoSounds accurate to me, but I'm interested if people will downvote you because they don't like the IT line.
- delinka 8y agoLooks like it gets worse down the list, so I don't think the IT folk will complain too much. edit: Yes, whether you feel "Civil engineering" is worse than "Hazmat engineering" is a subjective matter.
- melling 8y agoThe Electronic Coach video of Knuth mentioned in the article: https://youtu.be/dhh8Ao4yweQ https://youtu.be/dhh8Ao4yweQ He was ready for Moneyball and sports data science decades before everyone else.
- kieckerjan 8y agoHmpf, considering that the author spent a whole day with Knuth there is disappointingly little interviewing going on. Other people (e.g. Norvig) are quoted more extensively.
- li4ick 8y agoThat picture with Knuth and TeX is really beautiful to me.
- sytelus 8y agoOk, so this journalist gets to spend WHOLE day with Knuth and all we get is some bits of history and quotes from couple of Google guys. Massively lost opportunity to provide window in this legends daily life, thoughts and habits...
- time-domain0 8y agoBegs Toccata and Fugue in D minor
- rpeden 8y agoTo be fair though, Peter Norvig is a lot more than just a "Google guy". I'd happily read an article that's nothing but Norvig quotes. I thought that the article was pretty decent, considering it is aimed at an audience of people who aren't computer scientists and who have never heard of Donald Knuth.
- klenwell 8y ago> At age 19, Dr. Knuth published his first technical paper, “The Potrzebie System of Weights and Measures,” in Mad magazine. I'd say she did something positive with the opportunity.
- redshirtrob 8y agoI have a copy of the issue, so when I went to see one of his Christmas Tree Lectures a few years ago I took it with me to get signed after the talk. Instead of just signing it, he opened to his article and corrected a typo in the Potrzebie article--I think it amounted to two numbers being transposed somewhere around the millionths place (My copy is packed away from a recent move so it's not too convenient to verify). What was funny was he had a poem he used to remember the order of the numbers after the decimal. He couldn't quite remember it, so he ssh'd into his home machine (or University, dunno), fired up Emacs, and opened a file containing the poem. Then he corrected the typo. And that's how Donald Knuth "signed" my copy.
- svat 8y ago
- widforss 8y agoTaking the opportunity to post the video of Knuth mishearing the question "What makes a good teacher?" as "What makes a good T-shirt?" at my uni. https://youtu.be/74BfHoE66rc?t=42m17s https://youtu.be/74BfHoE66rc?t=42m17s
- knodi123 8y agothat's my favorite gag from the Firefly tv show. Simon: Are you Alliance? Early: Am I a lion? Simon: What? Early: I don't think of myself as a lion. You might as well though, I have a mighty roar. Simon: I said "Alliance." Early: Oh, I thought... Simon: No, I was... Early: That's weird.
- ravishi 8y agoThat is so cool! He really liked the question!
- sus_007 8y agoThanks for sharing this. Definitely made my day :D
- areski 8y agoI want that T-shirt now!
- martythemaniak 8y agoI wish the guy would have let him answer as to what the CompSci equivalent of that T-Shirt is.
- blattimwind 8y agoRight? Because of that interruption we never get to have Don Knuth approved compsci T-shirts. Think before you act!
- mindgam3 8y agoA few years ago, while doing a bit of a family history research project (Knuth was my father's PhD advisor at Stanford), I stumbled across a rather awesome t-shirt design. May I humbly submit "Knuth is my homeboy" as my entry to the CompSci t-shirt contest. (not my own design, to be clear, I just came across it on the internet) https://geekz.co.uk/shop/store/show/knuth-tshirt.html https://geekz.co.uk/shop/store/show/knuth-tshirt.html And here is a shot of the recursive shirt in action: https://laughingsquid.com/jacob-appelbaum-donald-knuth-demonstrate-the-recursive-homeboys-principle/ https://laughingsquid.com/jacob-appelbaum-donald-knuth-demon...
- pjmorris 8y agoMy favorite Knuth story, attributed to Alan Kay (if you're around, would love confirmation): When I was at Stanford with the AI project [in the late 1960s] one of the things we used to do every Thanksgiving is have a computer programming contest with people on research projects in the Bay area. The prize I think was a turkey. [John] McCarthy used to make up the problems. The one year that Knuth entered this, he won both the fastest time getting the program running and he also won the fastest execution of the algorithm. He did it on the worst system with remote batch called the Wilbur system. And he basically beat the shit out of everyone. And they asked him, "How could you possibly do this?" And he answered, "When I learned to program, you were lucky if you got five minutes with the machine a day. If you wanted to get the program going, it just had to be written right. So people just learned to program like it was carving stone. You sort of have to sidle up to it. That's how I learned to program." [0] http://www.softpanorama.org/People/Knuth/index.shtml http://www.softpanorama.org/People/Knuth/index.shtml
- mschaef 8y agoThere's another interesting story about Knuth that's worth repeating here. http://www.leancrew.com/all-this/2011/12/more-shell-less-egg/ http://www.leancrew.com/all-this/2011/12/more-shell-less-egg... The tl;dr is that Knuth wrote an elaborate implementation of a program to solve a particular problem, and Doug McIlroy replaced it entirely with a six step shell pipeline. (Knuth's program was written using his literate programming tools, could be typeset in TeX, and involved some precise work with data structures and algorithms.) I love this story as an example both of Knuth's genius and perspective, but also as a way to show what his level of dedication can achieve. It's an amazing intellectual accomplishment. I also love this story as a demonstration what those of us without that skill and dedication can achieve using the advancements built on the work of Knuth and others.
- sobellian 8y agoI love that story, although I think the takeaway needs to be slightly updated. It's quite possible that a sorted word count was easiest to do with bash and unix utilities in 1992. Now, it's easier and more comprehensible in your favorite scripting language (which I'm assuming isn't bash). The real lesson is to program using the most powerful tools at your disposal.
- username33382 8y ago>“Here at Google, sometimes we just throw stuff together,” Dr. Norvig said, during a meeting of the Google Trips team, in Mountain View, Calif. “But other times, if you’re serving billions of users, it’s important to do that efficiently. A 10-per-cent improvement in efficiency can work out to billions of dollars, and in order to get that last level of efficiency, you have to understand what’s going on all the way down.” I'm interested in this low level systems opimization. What type of jobs hire for this work? What areas in graduate school should one focus in? Is this type of skill set still employable?
- chrisweekly 8y agoSRE (Site Reliability Engineer) is one such track.
- EliRivers 8y agoAmongst other things, know your hardware. For example, you could read the C++ spec forwards and backwards for a year and know your data structure big O notation just as well, but they will never tell you that inserting into the middle of a vector is faster than inserting into the middle of a linked list in a great many common cases. Sure, ideally you'd measure, but you need to have some idea of what options to even compare with your measurements.
- IfOnlyYouKnew 8y agoI may be missing something here, but your example seems to be a textbook case for big-O analysis. Writing in a vector is O(1), while linked list is O(n), isn’t it?
- jki275 8y agoWriting into a vector is O(n), writing into a LL is O(1), assuming you have an iterator to the location to write to. If you don't, then it becomes O(n), and writing into a vector can be O(1) if you're writing to the end. C++ stl, LL appending is always O(1) and writing into a vector is O(n). There are plenty of caveats to this and the documentation should be referenced. He's right btw that insert into a vector is generally faster in the C++ stl than insert into a LL. I don't recall off the top of my head why that is, just remember it's the case.
- mpweiher 8y agoFunny, The NeXT Book by Bruce Webster referred to Knuth as the "Obi Wan of Computer Science". I guess we can split the difference and agree on Jedi. :-)
- benj111 8y agoAh but who is the Han Solo of comp Sci?
- WillAdams 8y agoMy NeXT Cube was my introduction to TeX, and one for which I will be forever grateful. I just wish that there was a machine running OPENSTEP 5.0 (as I think of Mac OS X) which I wanted to buy --- I prefer pen computers (the highwater mark of my computing experience was an NCR-3125 running PenPoint paired w/ a NeXT Cube w/ a Wacom ArtZ graphics tablet).
- pmoriarty 8y ago"I was sitting in Steve's office when Lynn Takahashi, Steve's assistant, announced Knuth's arrival. Steve bounced out of his chair, bounded over to the door and extended a welcoming hand. "It's a pleasure to meet you, Professor Knuth," Steve said. "I've read all of your books." "You're full of shit," Knuth responded. http://www.folklore.org/StoryView.py?project=Macintosh&story=Close_Encounters_of_the_Steve_Kind.txt http://www.folklore.org/StoryView.py?project=Macintosh&story...
- drfuchs 8y agoNo way; I worked for him from 1978-1986, and never heard him say a naughty word. Also, I tagged along when he went to Apple to meet Jobs, who wanted to show him a late prototype of the Mac, and don’t recall hearing any such thing at the time (and it would have shocked me).
- why-el 8y agoWell the website is called "folklore", so I think your skepticism is well placed. ;)
- yreg 8y agoIs there a way to dispute the story on folklore? drfuch's comment should be appended there.
- dagw 8y agoThe story is 100% veritably folklore. I know this since I've been hearing the story for at least 20 years starring a good half dozen different characters. The fact that is almost certainly not true (and Knuth has denied it) seems quite irrelevant.
- aidenn0 8y agoI've also heard that story with several different people in the place of Jobs (mid 90's it was almost always Bill Gates, for example), making me believe it to be apocryphal.
- cschep 8y ago“I am worried that algorithms are getting too prominent in the world,” he added. “It started out that computer scientists were worried nobody was listening to us. Now I’m worried that too many people are listening.” cheers!
- laxd 8y agoDonald Knuth's 24th Annual Christmas Lecture: Dancing Links https://www.youtube.com/watch?v=_cR9zDlvP88 https://www.youtube.com/watch?v=_cR9zDlvP88
- joaorico 8y agoI like these two quotes of Knuth where he lets us know how hard he worked. -- From this small interview [1]: "When I'm working on a research problem I generally begin by filling dozens of sheets of scratch paper with partial calculations. When I eventually get to a point where I can think about the problem while swimming, then I'm often ready to solve it." -- From this other interview [2]: "So I went to Case, and the Dean of Case says to us, says, it’s a all men’s school, says, “Men, look at, look to the person on your left, and the person on your right. One of you isn’t going to be here next year; one of you is going to fail.” So I get to Case, and again I’m studying all the time, working really hard on my classes, and so for that I had to be kind of a machine. I, the calculus book that I had, in high school we — in high school, as I said, our math program wasn’t much, and I had never heard of calculus until I got to college. But the calculus book that we had was great, and in the back of the book there were supplementary problems that weren’t, you know, that weren’t assigned by the teacher. The teacher would assign, so this was a famous calculus text by a man named George Thomas, and I mention it especially because it was one of the first books published by Addison-Wesley, and I loved this calculus book so much that later I chose Addison-Wesley to be the publisher of my own book. But Thomas’s Calculus would have the text, then would have problems, and our teacher would assign, say, the even numbered problems, or something like that. I would also do the odd numbered problems. In the back of Thomas’s book he had supplementary problems, the teacher didn’t assign the supplementary problems; I worked the supplementary problems. I was, you know, I was scared I wouldn’t learn calculus, so I worked hard on it, and it turned out that of course it took me longer to solve all these problems than the kids who were only working on what was assigned, at first. But after a year, I could do all of those problems in the same time as my classmates were doing the assigned problems, and after that I could just coast in mathematics, because I’d learned how to solve problems. So it was good that I was scared, in a way that I, you know, that made me start strong, and then I could coast afterwards, rather than always climbing and being on a lower part of the learning curve." [1] http://authenticinquirymaths.blogspot.pt/2015/11/maths-in-sc.. http://authenticinquirymaths.blogspot.pt/2015/11/maths-in-sc.... [2] Transcript from here: https://github.com/kragen/knuth-interview-2006 https://github.com/kragen/knuth-interview-2006
- yread 8y agoI was also scared in the first year of college next to all these accomplished programmers and math wizards and it definitely helps!
- orliesaurus 8y agoGood article, two things: I noticed looking at the pictures after reading the whole thing in a go... He looks nothing like Yoda! Wondering what made the author pick that title! He has/had a standing desk at home!
- commandlinefan 8y agoSomebody actually changed the title of the post, so now it only says Yoda and doesn't reference Knuth at all. Seems backwards to me.
- orliesaurus 8y agoyeah that's even worse: it's super click-baity now
- AGorilla 8y agoMore like the George RR Martin of Silicon Valley
- enriquto 8y agoMy favorite Knuth quote: One of the first times I was ever asked about the title of my books was in 1966, during the last previous ACM national meeting held in Southern California. This was before any of the books were published, and I recall having lunch with a friend at the convention hotel. He knew how conceited I was, already at that time, so he asked if I was going to call my books "An Introduction to Don Knuth." I replied that, on the contrary, I was naming the books after him. His name: Art Evans. (The Art of Computer Programming, in person.)
- known 8y agoHe became bald by 25 :)
- gumby 8y agoKnuth has enormous patience for someone so productive. My son used to refer to Knuth as "that amazing harpsichord player" and didn't care about the computer science "stuff" I tried to tell him was really important. And he had plenty of time to sit down with a kid and go through the score of Fantasia Apocalyptica and laugh together at the musical jokes in the score. OTOH I either have to consciously decide not to stress about all the things I want to get done or else...stress and push hard. Yet the things I feel driven to accomplish are quite minor compared to Knuth's to do list!
- gglitch 8y agoCan anyone ID this keyboard depicted in the article? https://static01.nyt.com/images/2018/12/18/science/18SCI-KNUTH3/merlin_148127301_135dcdcd-2f22-47d1-a749-1b0d997864e5-superJumbo.jpg https://static01.nyt.com/images/2018/12/18/science/18SCI-KNU...
- sthgrau 8y agoIt looks like a Logitech Gaming Keyboard G110
- alok99 8y agoLooks like a Logitech G19 to me. I wouldn't have thought Knuth would have a gaming keyboard, let alone one with a screen. EDIT: I think the other comment is correct, a Logitech G110
- MagicPropmaker 8y agoI'm an old-school programmer (though not as old as Knuth) and I use a gaming keyboard. I like the "click click" and full travel and the new "buckle spring" keyboards I can get aren't as good as the cherry clicky ones. I learned to type on a a mechanical typewriter in High School and in college punched programs on keypunch machines. A lot of us old-timers use gaming keyboards.
- devereaux 8y agoGaming keyboard also have extra keys, which you can map to macro or other things you find useful. I usually remap the control keys to act as a modifier for Unicode characters (as Caps and Enter are my "Control" keys) but that's not much. I need more keys. I have 2 keys to switch to the next/previous tab, in browsers, consoles and programming environments- the same keys can switch virtual desktop with a modifier. I also have a key to invert my screen (black on white vs white on black), a key to either switch to a terminal doing a ssh to a specific server or spawn a terminal and start that ssh, etc. It takes some time but offer greater productivity. I dislike the ticking of mechanical keyboard, and I really prefer "chiclets" keyboard as they generally require less force to be applied, but I would consider a mechanical keyboard if only for the extra keys.
- owenversteeg 8y ago“He’s a maximum in the community. If you had an optimization function that was in some way a combination of warmth and depth, Don would be it.” I love that quote.
- sparrish 8y agoMy favorite book from Knuth isn't computer-related at all. 3:16 Bible Texts Illuminated https://smile.amazon.com/3-16-Bible-Texts-Illuminated/dp/0895792524 https://smile.amazon.com/3-16-Bible-Texts-Illuminated/dp/089...
- claar 8y agoWonderful! Thanks for sharing this.
- pbiggar 8y agoThe book where he discusses these is also wonderful: "Things a computer scientist rarely talks about". https://www.amazon.com/Things-Computer-Scientist-Rarely-Lecture/dp/157586326X https://www.amazon.com/Things-Computer-Scientist-Rarely-Lect...
- jordigh 8y agoDonald Knuth shaved the ultimate yak. He wanted to write a book with mathematics in it so he implemented what for decades has been industry-standard mathematical typesetting system: TeX. That's remarkable. I just wish he'd finish the book.
- fantispug 8y agoThe details are even hairier. He wrote TeX82 (modern TeX) in WEB, a literate programming language he invented that could be tangled into the Pascal machine code or weaved into literate documentation in ... TeX itself. In fact he wrote WEB itself in WEB and by hand compiled the output of the tangle program, which he ran on the tangle source to get the same output. He also wrote the program METAFONT to produce the typefaces, which he used to design the Computer Modern font. And then he used that to write instruction books for TeX and METAFONT as well as new editions of The Art of Computer Science and others. TeX is still in regular use in the academic community (ported via Web2C) over 35 years later, despite the changes in technology in that time (with hacks to deal with modern fonts, outputting PDFs instead of DVI, including images and the like). He taught the yak to shave itself, and it's still clean shaven 35 years later.
- azag0 8y ago"In regular use" is an understatement. Virtually all manuscripts published on Arxiv.org, which comprises a large portion of all contemporary physics research output, is typeset in Latex.
- criddell 8y ago> Dr. Knuth has gone so far as to argue that some computer programs are, like Elizabeth Bishop’s poems and Philip Roth’s “American Pastoral,” works of literature worthy of a Pulitzer. I'd love to know which programs he's thinking of. Any ideas?
- luord 8y agoI'd vote for at least some parts of PostgreSQL.
- martinhath 8y agoI think this is from the back of Physically Based Rendering[0] by Pharr, Humphreys, and Jakob (3rd ed). The book is also available online[1]. [0]: https://www.pbrt.org/ https://www.pbrt.org/ [1]: http://www.pbr-book.org/ http://www.pbr-book.org/
- luord 8y agoI was unsure of what to get for christmas. Now I know, I want the full collection of "the Art of Computer Programming".
- wglb 8y agoI actually put that on my amazon wish list two years ago and presto it was successful. I put the four volumes next to the three first editions that I have.
- jsymolon 8y agoIt's not a novel to read through, front to back. Even Dr. Knuth says to skip around and read relevant chapters.
- derangedHorse 8y agoIt can also be read through fine though. I’ve gotten the first volume and read through the beginning without too much trouble, although the whole book is so long and dense I don’t think I’ll be able to finish for a while...
- dekhn 8y agoTrue Jeff Dean story time (this was directly related to me): when Jeff spoke at Stanford, it was so crowded, Knuth had to sit on the floor (I think somebody eventually noticed and offered him a seat).
- larrywright 8y agoJust out of curiousity, does anyone know what kind of notebooks and paper he’s using in the photo captioned “A few notes”?
- svat 8y agoYes the notepaper with triangular tiling was gifted at Knuth's 80th birthday celebration in Piteå, Sweden: http://knuth80.elfbrink.se/ http://knuth80.elfbrink.se/ (Sorry I don't remember where I read/heard about this.)
- svat 8y agoAh one place I ran across this: see 16:05 of Knuth's 2017 Christmas lecture (https://www.youtube.com/watch?v=BxQw4CdxLr8 https://www.youtube.com/watch?v=BxQw4CdxLr8): > I got a nice piece of paper here to work with. They had a conference in Poland last year [BachoTeX 2016] and they sent me this nice pad of paper and I like it so much that I decided at my birthday party next month I gotta give out notepaper that's... [audio drowned by laughter] But actually the notepaper at my birthday party is going to be triangle... paper. Because I have a feeling that all kinds of mathematics has never been invented yet because people haven't been given triangle... [laughter].
- timcederman 8y agohttps://blog.codinghorror.com/the-enduring-art-of-computer-programming/ https://blog.codinghorror.com/the-enduring-art-of-computer-p... contains images from his Mad Magazine article.
- purplezooey 8y agoThese books are truly amazing and I refer to them often. What I like the best is that they are so thorough that you know they are right, vs. the first google search hit.
- reggieband 8y agoThere are a few names in CS that stand out to me as legendary. Some examples are Von Neumann and Turing. IMO, Knuth stands among them.
- deleted 8y ago[deleted]
- mayankkaizen 8y agoI always had hard time imagining how Von Neumann can be so intelligent? There were geniuses and then there was von Neumann.
- aligshow 8y agoHow much more condescending can this get? Comparing a real person to a fictionalized non-human?
- sailfast 8y ago> "Following Dr. Knuth’s doctrine helps to ward off moronry. He is known for introducing the notion of “literate programming,” emphasizing the importance of writing code that is readable by humans as well as computers — a notion that nowadays seems almost twee." I liked a lot of this profile, but this came off as kind of weird.
- IfOnlyYouKnew 8y agoI seem to remember older programming languages (COBOL?) being far closer to English-as-spoken as they are today, using, for example Do/END instead of today’s more common c-style { and }.
- Roboprog 8y agoLiterate programming has next to nothing to do with “English like grammars” or “self documenting” tongue twister symbol table names. It has to do with writing documentation, and embedding little bits of code to do what the documentation describes, with a special build process to create the compiled program from the snippets within the documentation. It’s kind of the inverse of Javadoc.
- pengstrom 8y agoI had the pleasure to attend his 80th birthday conference (http://knuth80.elfbrink.se http://knuth80.elfbrink.se) in Piteå, Sweden where he also premiered his piece Fantasia Apocalyptica for church organ. We attended the conference as students but still got to see the conference, listen to the music and be at the birthday dinner free of charge. When I talked to Knuth I was amazed by his humility. Every presentation was about how grand he was, but he still was humble and friendly. They say you shouldn't meet your heroes, but they're obviously not talking about Knuth!
- maxtollenaar 8y agoMy favorite Knuth quote: "Email is a wonderful thing for people whose role in life is to be on top of things. But not for me; my role is to be on the bottom of things. What I do takes long hours of studying and uninterruptible concentration. I try to learn certain areas of computer science exhaustively; then I try to digest that knowledge into a form that is accessible to people who don't have time for such study." source: https://www-cs-faculty.stanford.edu/~knuth/email.html https://www-cs-faculty.stanford.edu/~knuth/email.html
- samstave 8y agoThats an amazing quote. Reminds me of a "hermit-like wizard in his tower in solitary uninterrupted study of their craft."
- marmot777 8y agoOr the scholar/monk archetype.
- schwurb 8y agoI once used two weeks of vacation to learn category theory - that was a really fun and rich time. It really relaxed me, but it also brought me more knowledge than one year of shallowly engaging with the topic.
- james_s_tayler 8y agoI've heard many times on HN people bring up category theory and how beneficial it has been to learn it, so I've recently ordered a textbook on it. Can I ask how has it benefited your thinking? I'm curious to know not only how it benefits an understanding of software development, programming languages and functional programming, but also has it helped you understand the world at large in new and novel ways?
- whatshisface 8y agoIf category theory is your first exposure to proofs and logic it can benefit you a lot, although number theory might be a more fun and more concrete way to get the same result. If you know a lot about more than one field of math, as a great big generalization over everything category theory can also help. I should warn you that there is a social bias towards saying that you found a lot of insight in studying something, and a bias against saying that studying it was a waste of time, irrespective of whether or not the thing is actually helpful. Aristotle could stare at a rock and end up with some insight, so anyone who stares at a rock and admits it hasn't helped them has to publicly admit they are not as smart as Aristotle. They say this is how geology got started. ;)
- 40acres 8y agoI just read the outline for volume one, sounds really interesting. Has anyone read V1? What sort of mathematical background is required to understand it? Is it proof heavy and really terse like CLRS?
- commandlinefan 8y agoI've read the first three, and attempted every single exercise (besides the few he marks as "suggested research problems"). It took me four years to finish, and I had a MSCS when I started. The first volume is probably the most math-intensive, but also the easiest, since a lot of the math is review. V1 is split into two parts: a pure math half, and then a programming half. All of the programming examples and exercises are done in a custom assembler that he calls MIX, but you can find emulators online to run your programs. I've read CLRS and Knuth and I definitely enjoyed Knuth a lot more - there's just something about his writing and exposition that makes the books compelling. They dare as well as entice you to understand them. It's not really as proof-heavy as CLRS IMHO, and TAOCP covers different ground that CLRS does; the only real overlap there is that volume 3 covers sorting algorithms.
- Jtsummers 8y agoIf you like the math in Volume 1, or find yourself having difficulty with it, Concrete Mathematics is a good companion (though also challenging). It goes into greater depth on some of the topics in Chapter 1 of TAOCP and some additional directions. It started as a course aimed at providing the mathematical basis for going into TAOCP.
- commandlinefan 8y agoYep, that's on my (very long) to-read list.
- Koffiepoeder 8y agoKnuth himself puts it this way: https://i.imgur.com/1czRNCK.png https://i.imgur.com/1czRNCK.png
- johnvega 8y agoGolang comes to mind when I read this: "He is known for introducing the notion of “literate programming,” emphasizing the importance of writing code that is readable by humans ... "
- IfOnlyYouKnew 8y agoI believe he was thinking far more of something like Jupyter Notebook. I’m waiting for VSCode to implement a bit of API that would allow me to start on an extension turning comments into first-class citizen, with, for example, diagrams, links, or images.
- currymj 8y agoBut it's not really literate programming as Knuth envisioned it. A very important point was that you could write things in any order, and then use tangle to produce source code in the correct order for execution. Jupyter notebooks don't enable this, and in practice evaluating cells in the wrong order is a common mistake if you aren't careful (I've often just given up and restarted the kernel). Imagine if they did, though. You could do something like put all your imports and preprocessing in an appendix. Or even more complicated: something like writing the inner loop of a function first, discussing it, and only afterwards writing the rest of the function and all the scaffolding. This would be great, but I've yet to see a true literate programming tool that would actually be usable for my day to day tasks.
- zaarn 8y agoTempleOS has this, sort of. The normal fileformat for code on TempleOS allows embedding images into the code and directly referencing it. The documentation also automatically generates links to the correct functions and you can generally find all relevant code bits to some piece of documentation. The terminal in TOS also natively supports images.
- andrewbinstock 8y agoGolang is not what Knuth has in mind. Literate programming is primarily long explanatory comments written around code snippets in a narrative form. Such that you could sit down and read a whole listing as you would a book. When I interviewed Knuth in 2008 [1], we discussed the failure of literate programming. As you'd expect, he was realistic about the reasons. (About half way down the page) [1] http://www.informit.com/articles/article.aspx?p=1193856 http://www.informit.com/articles/article.aspx?p=1193856
- dragontamer 8y agoKnuth is just ONE section away from writing about my (current) topic of study: Constraint Programming. His 4th volume of TAOCP is so big that its beginning for him to take decades to write sections. Backtracking search + 3-SAT solvers is really interesting (and very closely related to Constraint Programming), but I'm deeply curious to know what his take on Constraint Programming will be. Its really odd to be "waiting" for the next chapter of TAOCP. Its a serious body of work that has spanned decades of research and writing... I really hope he finishes the next section sooner. Maybe I'll go and buy the fascicle for 3SAT and read it while waiting.
- svat 8y agoIn his recent Dancing Links talk (a couple of weeks ago), he mentioned a generalization of exact cover that also covers constraint programming. You may want to look into that (XCC) in the meantime, in Knuth's fascicle on Dancing Links (https://cs.stanford.edu/~knuth/fasc5c.ps.gz https://cs.stanford.edu/~knuth/fasc5c.ps.gz). I know the feeling of waiting for new chapters of TAOCP; I'm waiting for Chapter 8 on recursion because his idea of it is so different from everyone else's.
- taeric 8y agoWhat makes his idea different from everyone else's? I know he covers coroutines, being something not really available in most languages. That said, I thought it was an accepted term and I didn't think that was his invention.
- dragontamer 8y ago> What makes his idea different from everyone else's Depth and coverage. Case in point: Knuth's coverage of Quicksort doesn't calculate the Big-O. It calculates the precise average running time. He literally counts the assembly-language statements. You might say "But arrays might be randomly sorted", and yeah, Knuth averages the runtime across all possible ways that an array can be sorted. Its a beautiful work of math. There's almost no room for questions once Knuth finishes a subject. Its so exhaustively covered that I can't even imagine questions I have on any subject after he's done writing about it. The few questions I do have are the "Difficulty 40+" questions that Knuth puts at the end of each section, which would serve as excellent questions for Masters Thesis or a PH.D Thesis. IE: There's no answer to those questions yet. Anyway, while most textbooks hand-wave the idea of "Quicksort is faster than Mergesort, even both are O(n*log(n))". Knuth is pretty simple, he says: Look at these two precise numbers I've calculated (and proved). Quicksort is faster (or at least, the Assembly-language version of Quicksort he wrote on his imaginary computer is faster) Basically, Knuth got "to the bottom of it", there's no hand-waving involved in the explanation. He just tackles the hard questions head on and solves it more precisely than everyone else. ---------- Some of the older chapters are going out of date, which is natural for a work so complete. There is so much material out there that Knuth has to make a decision on whether to revise older stuff (which he does occasionally) or to write about subjects which don't have a major unifying work yet (ie: Constraint Programming has some textbooks here and there, but most of its ideas are only in academic journals, and haven't really been unified into a singular work yet IMO. Even the textbooks on the subjects are mostly introductions + references to papers) And sometimes, Knuth gets lucky. Knuth's Book3 "Searching and Sorting" includes a HUGE table of sorting methods applied to tape drives. But today's RAM is now faster sequentially rather than random-access. So Knuth's calculations on Tape-Drive sorts actually applies to modern DDR4 RAM better than any other treatment on the subject. No one else calculated the cost of "internal movements" (aka: cache on modern systems, but it was RAM on older computers) + "external movements" (which was Tape Drives in Knuth TAOCP / Book 3, but is really DDR4 RAM on today's machines). So yeah, Book 3 is out of date and focuses a huge amount of time on external sorting methods. But... it just so happens that if you know a bit about the sequential nature of modern DDR4 RAM, it is actually super-relevant to today's computers.
- theonething 8y agoAs mentioned in the article he is also a devoted Christian and one of the smartest I know of. Some of his writings on the subject: https://www-cs-faculty.stanford.edu/~knuth/things.html https://www-cs-faculty.stanford.edu/~knuth/things.html https://www-cs-faculty.stanford.edu/~knuth/316.html https://www-cs-faculty.stanford.edu/~knuth/316.html
- rdiddly 8y agoFor some reason on this particular article I found it amusing to realize several times that a given concept they were talking about was something I'm familiar with, but it had been translated first from "nerd language" into "layman." Pretty common practice for a general audience, so I'm not sure why it stood out this time. Examples: bytecode, assembly language, frameworks, machine learning. Counterexample: Libraries, where they used the actual word, denying me the silly little pleasure of going "Oh you mean libraries."
- Rebelgecko 8y agoI actually thought this article did a really good job (certainly better than most) at explaining complex CS concepts.
- Fede_V 8y agoThe world would be such a better place if there were 1000 more people like him. What a wonderful human being.
- laxd 8y agoDonald Knuth, Noam Chomsky, David Attenborough. I don't see why we need more arguments to allow human cloning :p
- riemannzeta 8y agoOnce met Yoda himself on the 59th street platform of the Metra next to the University of Chicago. He needed to get to the airport within 45 minutes. I told him he needed to call a cab. Now I get to tell people I once helped him optimize an algorithm. ;-P
- anderspitman 8y agoDon't have time to look through the code right now, but it seems like a lot of these effects could be implemented as cellular automata (a la Conway's Game of Life). Obviously there are some more advanced simulations going on here though.
- jcoffland 8y ago> More worrisome, perhaps, are the algorithms that are not written by humans, algorithms written by the machine, as it learns. Can anyone show even one example of a computer writing an original and useful algorithm on it's own? Total misunderstanding of deep learning and "AI" is so common in today's PopSci.
- mav3rick 8y agoWhen weights are tuned you are technically left with a different behavior of an algorithm than when it started. When this tuning happened automatically, it's not really a misunderstanding.
- jcoffland 8y agoWeights are just input data so you are still left with the same algorithm.
- currymj 8y agoI actually think this is a pretty literal description of automatically learned decision trees, which are used in practice (directly or as sub parts of state-of-the-art techniques like gradient boosting). It is basically learning a series of complex nested if statements. Edit: also, there is actual work done in so-called “program synthesis”, especially employing Bayesian techniques, although it’s way more experimental and I haven’t heard of it being used “in the wild”.
- modriano 8y agoDecision tree models are trained by a machine learning algorithm that a human implemented. DTrees don't create new algorithms, they are calculated/trained through the application of an algorithm on data. You can find these DTree-generating algorithms in any decent machine learning algorithm textbook, and you can execute the steps by hand. For example, on page 56 (or pdf page 68) of [0], you can step through the ID3 decision tree algorithm. At no point is a new algorithm generated. [0]: https://www.cs.ubbcluj.ro/~gabis/ml/ml-books/McGrawHill%20-%20Machine%20Learning%20-Tom%20Mitchell.pdf https://www.cs.ubbcluj.ro/~gabis/ml/ml-books/McGrawHill%20-%...
- yalogin 8y agoOne thing I found really fascinating in the article is, the author when trying to provide an example of an algorithm used the "Command+F" combination to suggest searching on a page. This is distinctly a mac thing. Not just that it doesn't exist on Windows. Have we moved to a point where using Mac only things is acceptable in a general article like this? I mean, even now the bulk of the machines in the world run Windows, so is that an error in proof reading or is that ok now? I couldn't have imagined someone doing that 10 or even 5 years ago.
- slaman 8y agoNot sure why I'm engaging this... I think it was allowed because that knowledge of the shortcut is ubiquitous enough that it is understood by most everyone. I imagine the offices at the times use Macs. I'd also argue that "the bulk of the machines in the world" run unix-like operating systems by no small margin. It's true though that for most of the past few decades 'Ctrl+F' would make more sense, and it still remains an interesting editorial decision.
- radiusvector 8y agoMy Uncle is a researcher and has one of those famous checks from Knuth for pointing out an error in the book. Needless to say, he never intends on cashing it in, and treats it like a little trophy.
- ignoramous 8y agoOne fine spring afternoon, I saw Don Knuth at the Golden Gate Park. I think he and his partner were out bird watching or some such thing. I decided not to approach them and let them be. Seeing him in person is something I'd never forget and take it with me to my grave. Such is the mastery of their craft that even a glimpse of their presence from a distance leaves a lasting impression. Don Knuth is simply too precious.
- xendo 8y agoPartner? Jill is Donald's wife since 1961!
- ChuckMcM 8y agoWhen Java was new, James Gosling and I gave a talk about it to a group that included Don. When we gave the talk I was in the process of leaving Sun for a startup. A couple of years later Don mentioned to me that the talk was the first time we met and, at the time, he couldn't figure out if I was really smart or really stupid for leaving Sun right after Java shipped. In 2010 we both agreed that in the long term, it was the right choice for me, but neither he nor I could have predicted that at the time.
- mnemotronic 8y agoAt some point, I loaned out Vols 1 & 3 of my 1981 edition to a co-worker then forgot about it. Adios! Same thing happened to my DVD set of "The Prisoner" series with Patrick McGoohan. Let that be a lesson: If you loan something out, consider it a gift.
- Roboprog 8y agoIrony: “literate programming” means pretty much the opposite of “self documenting code” (AKA - undocumented code) First write the documentation, then embed relevant bits of code next to the relevant discussions, then have a special compiler / build process create the binary / program.
- rampart81 8y agoI remember when I took the programming algorithm class back in college. That was the first time I saw Dr. Knuth's book the art of programming... and I was thinking "what the? Are we supposed to read this?"
- gshubert17 8y agoKnuth says in the Preface to Volume 1 that "A shorter version of Volumes 1 through 5 [chapters 1-10] is planned, intended specifically to serve as a more general reference and/or text for undergraduate computer courses; its contents will be a subset of the material in these books, with the more specialized information omitted." I realize he can't shorten what he hasn't written, but I wish he had been able to write this shorter version years ago, and then work on filling in the details in the now-ever-expanding sequence of in-depth volumes.
- bjourne 8y agoI've been at one of his Ask Me Anything-lectures. They are pretty cool, but I feel that they are limited by the audiences questions. If he doesn't get interesting questions then he can't provide interesting answers. I wanted to ask if he had Autism because he looks, talks and walks as if he had, but I didn't get the chance. I wonder if Knuth has elaborated on the subject? Anyone knows?
- svat 8y agoIt's really rude to ask someone about their medical conditions, even more so in public. Please don't do that. It is also not a good idea to attempt to diagnose psychological issues from a distance. (But if we're playing that game, Wikipedia defines "autism" as "a developmental disorder characterized by troubles with social interaction and communication, and by restricted and repetitive behavior", and Knuth is supremely good at communication and remarkably good at social interaction for a (self-described) "geek" -- if you go over his life history (e.g. https://www.youtube.com/playlist?list=PLVV0r6CmEsFzeNLngr1JqyQki3wdoGrCn https://www.youtube.com/playlist?list=PLVV0r6CmEsFzeNLngr1Jq...) and consider all his activities -- being part of social clubs and fraternities, helping with the basketball team, dating and getting married, playing pranks on people, the affection with which he talks about his wife and children, his humorous outlook, etc -- then there does not seem to be any evidence of what you're thinking. Even the current article speaks of his warmth. But really, we shouldn't be doing this.)
- peter303 8y agoDK still gives an annual lecture at Stanford at the end of the year. Here is this years: http://scpd.stanford.edu/free-stuff/live-webinars-lectures/donald-knuths-annual-christmas-lecture http://scpd.stanford.edu/free-stuff/live-webinars-lectures/d...
- sudovancity 8y agoI love all the Knuth stories in here, shows how much of an impact this man had on us.