3 ms·

All Hacker News posts dataset on Google BigQuery

• alastairr 2y ago
  This has appeared on HN a few times before - but it's so useful that it seems worth resharing periodically.
• cranberryturkey 2y ago
  Is it free to use?
  • alastairr 2y ago
    yes, although there is a paid tier they try to upgrade you to. worth noting that there are some limits on how much data you can export in one go - I found the easiest way was to dump out pieces you need to google drive.
    • cranberryturkey 2y ago
      what about their github api?
      • alastairr 2y ago
        what about it?
  • manx 2y ago
    You can use it for free from kaggle: https://www.kaggle.com/code/felixdietze/hacker-news-score-analysis https://www.kaggle.com/code/felixdietze/hacker-news-score-an...
• zX41ZdbW 2y ago
  I have this dataset being updated in ClickHouse in real-time: https://play.clickhouse.com/play?user=play#U0VMRUNUIG1heCh0aW1lKSBGUk9NIGhhY2tlcm5ld3NfaGlzdG9yeQ== https://play.clickhouse.com/play?user=play#U0VMRUNUIG1heCh0a... I also provide a way to export it or attach it to clickhouse-local and analyze it locally: https://github.com/ClickHouse/ClickHouse/issues/29693#issuecomment-2185388881 https://github.com/ClickHouse/ClickHouse/issues/29693#issuec...
  • alastairr 2y ago
    this is great, thanks for sharing
• deleted 2y ago
  [deleted]