4 ms·
So, I just manually checked via Algolia for total story mentions for all time as of this writing. Keep in mind that this is not front-page mentions necessarily
by dredmorbius 3y ago
So, I just manually checked via Algolia for total story mentions for all time as of this writing. Keep in mind that this is not front-page mentions necessarily, though it might be possible to crawl the "past" links to get those: <https://news.ycombinator.com/front https://news.ycombinator.com/front>.
Maine (22,890) and Iowa (19,353) both beat out Colorado and California. Why the Maine love I've absolutely no idea.
"Washington" appears 22,246 times, though that's massively confounded by appearances of "Washington Post" (18,634). Adding "state" as a qualifier (e.g., "state of..." or "... state") reduces that to 461 instances. "Seattle" alone appears nearly 5,000 times which would be 9th overall (sorry, Florida). "Redmond" gives another 892 occurrences.
Colorado is actually 11th most frequently occurring state name.
If you include cities and toponyms from within California (SF, SJ, Los Angeles, SD, SV, Hollywood, Palo Alto, Menlo Park, Stanford, etc.), there are well north of 30k mentions of the state or regions within it.
10 most mentioned: ME (22,890), IA (19,353), CA (10,839), NY (9,009, including NYC matches as they're within the state), IN (6,151), TX (5,603), OH (5,085), FL (2,556), VA (2,369, excluding WV).
10 least mentioned: SD (93), RI (98), NH (136), ND (150), NE (159), WV (161), SC (178), WY (209), NM (213), VT (229).
Data (with additional cities/regions or confounding searches listed for some cases):
Alabama: 372
Alaska: 1,127
Arizona: 914
Arkansas: 264
California: 10,839 (Cities/regions: San Francisco: 7,221, San Jose: 493, Los Angeles: 1,540, San Diego: 732, Sacramento: 187, Silicon Valley: 13,782, Hollywood: 3,050, Palo Alto: 833, Menlo Park: 120, Redwood City: 33, Santa Clara: 199, Santa Cruz: 96)
Connecticut: 1,369
Colorado: 1,633
Delaware: 612
Florida: 2,556
Georgia: 1,350
Hawaii: 883
Idaho: 274
Illinois: 789 (Chicago: 3,634)
Indiana: 6,151
Iowa: 19,353
Kansas: 573
Kentucky: 301
Louisiana: 294
Maine: 22,890
Maryland: 921
Massachusetts: 620
Michigan: 1,456
Minnesota: 530
Missouri: 314
Mississippi: 248
Montana: 486
Nebraska: 159
Nevada: 580 (Las Vegas: 582, Reno: 84)
New Hampshire: 136
New Jersey: 491
New Mexico: 213 (Albequerque: 48, Los Alamos: 89)
New York: 9,009 (New York City: 1,905, Manhattan: 2,355, Wall Street: 2,934)
North Carolina: 368
North Dakota: 150
Ohio: 5,085
Oklahoma: 277
Oregon: 911
Pennsylvania: 358
Rhode Island: 98
South Carolina: 178
South Dakota: 93
Tennessee: 287
Texas: 5,603
Utah: 1,005
Vermont: 229
Virginia: 2,530 (less West Virginia: 161)
Washington: 22,246 (though many confounding matches: Washington Post: 18,634, Washington + state: 461, Washington DC: 369, Washington D.C.: 112. Seattle: 4,958, Redmond: 892.) Actual is closer to 461.
West Virginia: 161
Wisconsin: 387
Wyoming: 209
- dredmorbius 3y agoAnd, after looking again at HN's API and determining that front pages aren't represented in it ... I'm crawling the 5,939 front pages from 20 Feb 2006 to 25 May 2023 and scraping those to find mentions of states on the actual front pages. Aggressive crawls result in 403 after a few fetches, so my current attempt has an apparently-adequate delay parameter set. It'll take a day or two for the crawl to complete. Presently up through 22 Sept 2007. State-name matches (with some false positives) in that set: Delaware corporate franchise tax is due today (March 1st) (March 1, 2007) An Early Stage Entrepreneur's Guide to New York City (March 5, 2007) Web 2.0 Expo 2007, April 15-18, 2007, San Francisco, California (March 10, 2007) Zillow Becomes Illegal in Arizona (April 16, 2007) New York Times on the social news uproar (May 3, 2007) What Silicon Valley Could Learn from Columbus, Ohio (May 22, 2007) New York Times Will Lower Editorial Standards Online And Reduce Size Of Print Newspaper (May 26, 2007) eHarmony sued in California for excluding gays (June 1, 2007) New York Times versus Digg (June 6, 2007) A Patent Lie - New York Times (June 9, 2007) Interactive Colorado Nightlife Guide - "Social Nightworking" (June 16, 2007) In the state of Hawaii, tax breaks make tech investments nearly risk-free? (June 27, 2007) Top Web Apps in Arizona (June 28, 2007) Millionaires Cash Out Of California (July 16, 2007) C.E.O. Libraries Reveal Keys to Success - New York Times (July 21, 2007) Pics of Web Company HQs in California - Digg, Facebook, OpenDNS.. (July 25, 2007) Hackers find serious problems in California voting machines (July 30, 2007) A Mystery Solved: "Fake Steve" Blogger Comes Clean - New York Times (Aug 5, 2007) Colorado Startup Scene (Aug 5, 2007) New York Times Sees Sense: Paywall Comes Crashing Down (Aug 7, 2007) Parsing Miss South Carolina's Statement (Sept 1, 2007) Texas Startup Says It Has Batteries Beat (Sept 5, 2007) Spider-like vessel hits New York waters - can cross the Atlantic on one load of diesel fuel (Sept 8, 2007) New York Times Launches Facebook App (Sept 12, 2007) Theory Girl by the University of Washington CSE Band [mp3] (Sept 15, 2007) Note that seven of the "New York" mentions are for "The New York Times".
- dredmorbius 3y agoIn the event anyone wants to suggest analyses to perform, I'm game. For now, I'm parsing out title, points, comments, submitter, and the submission site. I'm classifying by state and city (list of 330 largest cities in the US by population), as well as a few "false positive" categories (e.g., "Washington Post", "New York Times"). One interesting angle I'm looking at is the average votes and comments by site within the data --- I'd been curious for a while as to which domains seem to be most highly considered (or at least successful in garnering votes and comments). I'm still waiting for the full archive to get pulled in, but early results are ... interesting. I'll leave it there. (Paulgraham.com rather predictably does well, though it's not the highest-rated.) I'm also thinking of ways to do trending over time. In early data (I'm up to late 2011 / early 2012 as I'm writing this), sites including Quora and even jwz.com appear and ... do well. plus.google.com hasn't yet appeared, and a few others that come to mind don't seem represented yet. Top sites by year or over a five-year interval seems potentially illuminating. Oh, and as far as states go, when restricted to front-page submissions only, California does far better than the Algolia search results (all non-dead/killed submissions) indicate.