16 ms·
There are quite a few titles which have appeared on the HN front page more than once. I've got an archive that's current as of a week or so back, and it shows
by dredmorbius 3y ago
There are quite a few titles which have appeared on the HN front page more than once. I've got an archive that's current as of a week or so back, and it shows 1,734 repeated titles.
The following 39 titles have appeared on the front page 5+ times, based on an exact text match, excepting a year indicator in parentheses, e.g., "(2023)". Note that the apostrophe glyph differs in the 2nd & 3rd entries for Peter Roberts AMAs:
1 10 OpenSSL Security Advisory
2 7 I'm Peter Roberts, immigration attorney who does work for YC and startups. AMA
3 7 I’m Peter Roberts, immigration attorney who does work for YC and startups. AMA
4 7 Richard Feynman and The Connection Machine
5 7 The Architecture of Open Source Applications
6 7 The TTY demystified
7 7 Why GNU grep is fast
8 7 You and Your Research
9 6 Bit Twiddling Hacks
10 6 Dictionary of Algorithms and Data Structures
11 6 How to be a Programmer: A Short, Comprehensive, and Personal Summary
12 6 The Bipolar Lisp Programmer
13 6 Why Lisp?
14 5 A Primer on Bézier Curves
15 5 A regular expression to check for prime numbers
16 5 Advanced programming languages
17 5 Akin's Laws of Spacecraft Design
18 5 Ask HN: Idea Sunday
19 5 Ask HN: What are you working on?
20 5 Beej's Guide to Network Programming
21 5 DNA seen through the eyes of a coder
22 5 Data Structure Visualizations
23 5 How Software Companies Die
24 5 How to Read Mathematics
25 5 How to Write a Spelling Corrector
26 5 Learning Advanced JavaScript
27 5 Notation as a Tool of Thought
28 5 Statistical Data Mining Tutorials
29 5 Structure and Interpretation of Classical Mechanics
30 5 Teach Yourself Programming in Ten Years
31 5 Ten Rules for Web Startups
32 5 Terms of Service; Didn't Read
33 5 The Book of Shaders
34 5 The Scientist and Engineer's Guide to Digital Signal Processing
35 5 The Tao of Programming
36 5 The case of the 500-mile email
37 5 Who Can Name the Bigger Number?
38 5 Why Lisp macros are cool, a Perl perspective
39 5 You can't tell people anything
A further 67 titles appear 4 times each, 259 appear 3x, and 2,120 appear twice.
("Front page" here means the archived HN front pages under the "past" link at the top of the page here.)
Data through 2023-06-21.
I could run the analysis based on the URL rather than title, but that would require parsing the raw HTML which I've yet to do.
- gcoladon 3y agoWhy doesn't "Why I Hate Frameworks" appear in your list? From dang's post it looks like that exact title has appeared 8 times? Possibly related: have you considered making your aggregator ignore punctuation and case in addition to the year indicators?
- dredmorbius 3y agoNot all appearances are front-page appearances. And my very quick & dirty shell one-liner requires precise text matches. "Why I Hate Frameworks" does appear six times on the front page, though with case and phrasing variants which mean that an exact text match won't pick it up: Why I Hate Frameworks Why I Hate Frameworks Why I hate frameworks (2005) Why I Hate Frameworks [dupe] Why I Hate Frameworks (2005) Why I Hate Frameworks (2005) By my shell one-liner, it would have been counted as appearing four times (instances 1, 2, 4, and 6 above). I could tweak the script by lowercasing (or title-casing) titles (I've a script that does the latter), and eliminating any instances of "[dupe]". While I'm at it, "[flagged]" and "[dead]" possibly as well, though I think the latter won't appear in the archive. And let's convert all apostrophe variants to a single apostrophe character (') (ASCII hex 0x27). With those adjustments, I see "Why I Hate Frameworks" appearing six times, as expected, and there are 57 titles appearing 5+ times, rather more than the 39 initially posted above. There are 3,077 repeated front-page titles in total. The one-liner, FWIW (rearranged to multiple lines): egrep '^ Title:' parse.log | sed 's/^ Title: //' | sed 's/([0-9][0-9][0-9][0-9]) *$//; s/\[dupe\]//; s/\[flagged\]//; s/^ *//; s/ *$//; s/ */ /g; ' | sed "s/’/'/g" | titlecase | sort | uniq -c | sort -k1nr | gawk '$1 > 1' | cat -n "titlecase" itself is a sed script that uppercases words, with specific exceptions. I've just augmented it with a few more technology-related terms. "parse.log" is the output of my first stage of parsing of the HN front page archive, which lists specific story properties in a tagged format, e.g., "Title:" "Date:" "Site:", etc.
- dredmorbius 3y agoAnd the updated list, 5+ appearances: 1 14 I'm Peter Roberts, Immigration Attorney Who Does Work for YC and Startups. AMA 2 11 Richard Feynman and the Connection Machine 3 10 Openssl Security Advisory 4 10 The TTY Demystified 5 8 Why GNU Grep is Fast 6 7 Cool URIs Don't Change 7 7 How to Read Mathematics 8 7 The Architecture of Open Source Applications 9 7 You and Your Research 10 6 -2000 Lines of Code 11 6 A Primer On Bézier Curves 12 6 Advanced Programming Languages 13 6 Bit Twiddling Hacks 14 6 Dictionary of Algorithms and Data Structures 15 6 How Not to Sort by Average Rating 16 6 How to Be a Programmer: a Short, Comprehensive, and Personal Summary 17 6 How to Write a Spelling Corrector 18 6 Keep Your Identity Small 19 6 Ten Rules for Web Startups 20 6 The Bipolar Lisp Programmer 21 6 The Tao of Programming 22 6 Why I Hate Frameworks 23 6 Why Lisp? 24 5 A Regular Expression to Check for Prime Numbers 25 5 A Spellchecker Used to Be a Major Feat of Software Engineering 26 5 Akin's Laws of Spacecraft Design 27 5 Ask HN: Idea Sunday 28 5 Ask HN: What Are You Working On? 29 5 Ask HN: Who's Hiring? 30 5 Beej's Guide to Network Programming 31 5 Data Structure Visualizations 32 5 Dna Seen Through the Eyes of a Coder 33 5 Game Programming Patterns 34 5 How Software Companies Die 35 5 How to Become a Good Theoretical Physicist 36 5 How to Design Programs, Second Edition 37 5 Latency Numbers Every Programmer Should Know 38 5 Learn C and Build Your Own Lisp 39 5 Learn You a Haskell for Great Good 40 5 Learning Advanced Javascript 41 5 Let's Build a Compiler 42 5 Notation As a Tool of Thought 43 5 Statistical Data Mining Tutorials 44 5 Structure and Interpretation of Classical Mechanics 45 5 Teach Yourself Programming In Ten Years 46 5 Terms of Service; Didn't Read 47 5 The Book of Shaders 48 5 The Case of the 500-Mile Email 49 5 The Early History of Smalltalk 50 5 The Scientist and Engineer's Guide to Digital Signal Processing 51 5 What ORMs Have Taught Me: Just Learn SQL 52 5 Who Can Name the Bigger Number? 53 5 Why I Left Google 54 5 Why Lisp Macros Are Cool, a Perl Perspective 55 5 Why Open Source Misses the Point of Free Software 56 5 Why to Start a Startup In a Bad Economy 57 5 You Can't Tell People Anything