6 ms·

For posterity, here's a spreadsheet of all Daring Fireball submissions to HN, sorted chronologically: https://docs.google.com/spreadsheets/d/1A7ljmWbHtFsB4VRJ1Q

For posterity, here's a spreadsheet of all Daring Fireball submissions to HN, sorted chronologically: https://docs.google.com/spreadsheets/d/1A7ljmWbHtFsB4VRJ1Q0dbs61GPU1M4sbG_jhrMT1Wn8/edit?usp=sharing https://docs.google.com/spreadsheets/d/1A7ljmWbHtFsB4VRJ1Q0d... From first glance there's still some decent traffic on Daring Fireball submissions, even inside the times Gruber asserts deadweighting.

minimaxir 2y ago
The data was retrieved from the public HN dataset on BigQuery: https://news.ycombinator.com/item?id=40644563 https://news.ycombinator.com/item?id=40644563 SELECT id, title, url, FORMAT_TIMESTAMP("%Y-%m-%d %H:%m:%S", timestamp, "America/New_York") AS submission_datetime, score, descendants as comments FROM `bigquery-public-data.hacker_news.full` WHERE type = "story" AND REGEXP_CONTAINS(url, r"daringfireball\.net") ORDER BY submission_datetime
- someothherguyy 2y ago
  Should be %H:%i:%S?
  - minimaxir 2y ago
    %i is not an option. https://cloud.google.com/bigquery/docs/reference/standard-sql/format-elements#format_elements_date_time https://cloud.google.com/bigquery/docs/reference/standard-sq... Looking it up it's only used in really old DBs. ...but that table reveals I should have used %M instead of %m. Whoops! Although in this particular case it doesn't make a difference. And apparently I can do "%F %X" instead of the whole string.
    - someothherguyy 2y ago
      Yeah, just looked wrong, didn't check the docs
shortformblog 2y ago
I respect that you did this. Nice quick data grab.
jgruber 2y ago
How then do you explain DF being #3 from 2007-2021 and #72 from 2021-2025? It’s clearly not blacklisted, but clearly is shitlisted, no?
- js2 2y ago
  Have you tried emailing hn@ycombinator.com and asking? From https://news.ycombinator.com/newsfaq.html https://news.ycombinator.com/newsfaq.html How are stories ranked? The basic algorithm divides points by a power of the time since a story was submitted. Comments in threads are ranked the same way. Other factors affecting rank include user flags, anti-abuse software, software which demotes overheated discussions, account or site weighting, and moderator action. I expect there's been an increase in user flags. BTW "Please don't comment about the voting on comments. It never does any good, and it makes boring reading." Same rule applies for submissions. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html FWIW, I'm a regular reader of your blog and have not flagged any daringfireball submissions. But this article is asking to be flagged. It's a needlessly provocative title and not all that interesting to discuss. I'd also like to point out a bit of hypocrisy on your part. You don't accept comments on your site. If you want folks to comment on your blog, maybe reconsider hosting the comments yourself? https://shawnblanc.net/2007/07/why-daring-fireball-is-comment-free/ https://shawnblanc.net/2007/07/why-daring-fireball-is-commen... https://daringfireball.net/linked/2010/06/16/powazek-comments https://daringfireball.net/linked/2010/06/16/powazek-comment... https://daringfireball.net/2010/06/whats_fair https://daringfireball.net/2010/06/whats_fair
  - dieulot 2y ago
    To be more explicit: asking hn@ycombinator.com why some submission vanished in a mysterious way does bring a clear answer in my experience.
  - doe88 2y ago
    I wonder can a submitted post be flagged without displaying the leading tag? Because there is definitively something preventing Gruber's posts from reaching the first page although most of his posts are not overtly flagged. But as you say he should ask @dang for more informations.
jimniels 2y ago
Cool! Made me want to try building it in Quadratic because you can tie the live data source into the spreadsheet. I didn’t use the more comprehensive dataset in big query [1] and I didn't use the firebase API [2] either because it's so much data to go through. Instead I used the Algolia search API [3] because it was easy ha. The resulting charts [4] are, if nothing else, interesting to look at and on first glance similar to what I see in the og google sheet. Disclosure: I work on Quadratic and this was a good exercise in using the product (and finding bugs). The spreadsheet is available to look at publicly [5] [1] https://console.cloud.google.com/bigquery?p=bigquery-public-data&d=hacker_news&page=dataset&invt=AbtKvg&project=personal-twitter-370603&ws=!1m4!1m3!3m2!1sbigquery-public-data!2shacker_news https://console.cloud.google.com/bigquery?p=bigquery-public-... [2] https://github.com/HackerNews/API?tab=readme-ov-file https://github.com/HackerNews/API?tab=readme-ov-file [3] https://hn.algolia.com/api https://hn.algolia.com/api [4] https://github.com/user-attachments/assets/a97ba432-d6dd-4d13-9349-2ce1629905a3 https://github.com/user-attachments/assets/a97ba432-d6dd-4d1... [5] https://app.quadratichq.com/file/033d2fa7-b205-4c27-9fce-24754b71b018 https://app.quadratichq.com/file/033d2fa7-b205-4c27-9fce-247...
- morberg 2y ago
  4 is broken link for me.

minimaxir 2y ago

The data was retrieved from the public HN dataset on BigQuery: https://news.ycombinator.com/item?id=40644563 https://news.ycombinator.com/item?id=40644563 SELECT id, title, url, FORMAT_TIMESTAMP("%Y-%m-%d %H:%m:%S", timestamp, "America/New_York") AS submission_datetime, score, descendants as comments FROM `bigquery-public-data.hacker_news.full` WHERE type = "story" AND REGEXP_CONTAINS(url, r"daringfireball\.net") ORDER BY submission_datetime

someothherguyy 2y ago
Should be %H:%i:%S?
- minimaxir 2y ago
  %i is not an option. https://cloud.google.com/bigquery/docs/reference/standard-sql/format-elements#format_elements_date_time https://cloud.google.com/bigquery/docs/reference/standard-sq... Looking it up it's only used in really old DBs. ...but that table reveals I should have used %M instead of %m. Whoops! Although in this particular case it doesn't make a difference. And apparently I can do "%F %X" instead of the whole string.
  - someothherguyy 2y ago
    Yeah, just looked wrong, didn't check the docs

shortformblog 2y ago

I respect that you did this. Nice quick data grab.

jgruber 2y ago

How then do you explain DF being #3 from 2007-2021 and #72 from 2021-2025? It’s clearly not blacklisted, but clearly is shitlisted, no?

js2 2y ago
Have you tried emailing hn@ycombinator.com and asking? From https://news.ycombinator.com/newsfaq.html https://news.ycombinator.com/newsfaq.html How are stories ranked? The basic algorithm divides points by a power of the time since a story was submitted. Comments in threads are ranked the same way. Other factors affecting rank include user flags, anti-abuse software, software which demotes overheated discussions, account or site weighting, and moderator action. I expect there's been an increase in user flags. BTW "Please don't comment about the voting on comments. It never does any good, and it makes boring reading." Same rule applies for submissions. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html FWIW, I'm a regular reader of your blog and have not flagged any daringfireball submissions. But this article is asking to be flagged. It's a needlessly provocative title and not all that interesting to discuss. I'd also like to point out a bit of hypocrisy on your part. You don't accept comments on your site. If you want folks to comment on your blog, maybe reconsider hosting the comments yourself? https://shawnblanc.net/2007/07/why-daring-fireball-is-comment-free/ https://shawnblanc.net/2007/07/why-daring-fireball-is-commen... https://daringfireball.net/linked/2010/06/16/powazek-comments https://daringfireball.net/linked/2010/06/16/powazek-comment... https://daringfireball.net/2010/06/whats_fair https://daringfireball.net/2010/06/whats_fair
- dieulot 2y ago
  To be more explicit: asking hn@ycombinator.com why some submission vanished in a mysterious way does bring a clear answer in my experience.
- doe88 2y ago
  I wonder can a submitted post be flagged without displaying the leading tag? Because there is definitively something preventing Gruber's posts from reaching the first page although most of his posts are not overtly flagged. But as you say he should ask @dang for more informations.

jimniels 2y ago

Cool! Made me want to try building it in Quadratic because you can tie the live data source into the spreadsheet. I didn’t use the more comprehensive dataset in big query [1] and I didn't use the firebase API [2] either because it's so much data to go through. Instead I used the Algolia search API [3] because it was easy ha. The resulting charts [4] are, if nothing else, interesting to look at and on first glance similar to what I see in the og google sheet. Disclosure: I work on Quadratic and this was a good exercise in using the product (and finding bugs). The spreadsheet is available to look at publicly [5] [1] https://console.cloud.google.com/bigquery?p=bigquery-public-data&d=hacker_news&page=dataset&invt=AbtKvg&project=personal-twitter-370603&ws=!1m4!1m3!3m2!1sbigquery-public-data!2shacker_news https://console.cloud.google.com/bigquery?p=bigquery-public-... [2] https://github.com/HackerNews/API?tab=readme-ov-file https://github.com/HackerNews/API?tab=readme-ov-file [3] https://hn.algolia.com/api https://hn.algolia.com/api [4] https://github.com/user-attachments/assets/a97ba432-d6dd-4d13-9349-2ce1629905a3 https://github.com/user-attachments/assets/a97ba432-d6dd-4d1... [5] https://app.quadratichq.com/file/033d2fa7-b205-4c27-9fce-24754b71b018 https://app.quadratichq.com/file/033d2fa7-b205-4c27-9fce-247...

morberg 2y ago
4 is broken link for me.