3 ms·

I host a publicly open database with Hacker News data at https://play.clickhouse.com/play?user=play#U0VMRUNUICogRlJPTSBoYWNrZXJuZXdzX2hpc3RvcnkgTElNSVQgMTAw htt

I host a publicly open database with Hacker News data at https://play.clickhouse.com/play?user=play#U0VMRUNUICogRlJPTSBoYWNrZXJuZXdzX2hpc3RvcnkgTElNSVQgMTAw https://play.clickhouse.com/play?user=play#U0VMRUNUICogRlJPT... So you can create any sort of similar services in a single SQL query and an HTML page. I also hosted it as a publicly accessible data lake, which you can query from everywhere: https://github.com/ClickHouse/ClickHouse/issues/29693#issuecomment-4755761107 https://github.com/ClickHouse/ClickHouse/issues/29693#issuec... It is also updated in real-time.

tgv 4mo ago
It probably also got swamped in real-time...
- linmer 4mo ago
  Do you mean it's not updated? You gotta sort by update_time column. Looks sorted, but you gotta sort it with a query like: SELECT * FROM hackernews_history ORDER BY update_time DESC LIMIT 100; And yeah, I got that from deepseek because I don't have a brain.
linmer 4mo ago
Thank you for providing this, you are a hero!!! I'm gonna try to do cool stuff with it!
GeoAtreides 4mo ago
oh hey, per HN terms and conditions I license my HN data only to HN. Can you please remove my data from the set? Thank you!
- pelagicAustral 4mo ago
  You must be fun at parties
- moralestapia 4mo ago
  By uploading any User Content you hereby grant and will grant Y Combinator and its affiliated companies a nonexclusive, worldwide, royalty free, fully paid up, transferable, sublicensable, perpetual, irrevocable license to copy, display, upload, perform, distribute, store, modify and otherwise use your User Content for any Y Combinator-related purpose in any form, medium or technology now known or later developed. @zX41ZdbW, you can safely ignore this guy. @GeoAtreides, next time read the actual terms of service before hallucinating.
  - GeoAtreides 4mo ago
    >Y Combinator and its affiliated companies is zX41ZdbW either?
    - moralestapia 4mo ago
      Oh, now I see my comment might be a bit harsh. I didn't consider you might now know about: https://github.com/hackernews/api https://github.com/hackernews/api
      - GeoAtreides 4mo ago
        yes, and per HN terms and conditions only YC and YC affiliated (as you quoted) can use the api legally. I don't license my content to anyone else and so it shouldn't be use by anyone else, even if it's available on a free-for-all API (nice move HN, btw).
        moralestapia 4mo ago
        https://github.com/HackerNews/API/blob/master/LICENSE https://github.com/HackerNews/API/blob/master/LICENSE It's right there, you just have to click the link I shared ...
        GeoAtreides 4mo ago
        that's the license for the API, not the content/data the API serves
- linmer 4mo ago
  Wait, so I have to ask for every single person's permissions to use this data? uhhhhhhhhhhhhhhhhhhhhhh
- snowwrestler 4mo ago
  Not sure if joking, but if this product is not republishing the text of your contributions (to which you hold copyright), you’re probably not going to convince a court to do anything here. Generally speaking it is not a violation to scrape, index, and analyze web content as long as you don’t republish copyrighted content without a license, or violate access controls. For example: search engine indexes.
- jrflowers 4mo ago
  Steve Carrell yelling “I DECLARE BANKRUPTCY!!” in The Office dot gif
  - rvba 4mo ago
    Is this GDPR territory with fines up to EUR 10 million or 2% of a company’s global annual turnover? Not sure what are the fines for some random person though
jstrieb 4mo ago
This is awesome! I do want to point out that the data in that ClickHouse playground only seems to go as far back as April 6, 2024 according to the query below: SELECT * FROM hackernews_history ORDER BY update_time ASC LIMIT 10 This is of course still extremely useful, and generous! It just wasn't obvious from the comment that this isn't querying against all Hacker News data.

tgv 4mo ago

It probably also got swamped in real-time...

linmer 4mo ago
Do you mean it's not updated? You gotta sort by update_time column. Looks sorted, but you gotta sort it with a query like: SELECT * FROM hackernews_history ORDER BY update_time DESC LIMIT 100; And yeah, I got that from deepseek because I don't have a brain.

linmer 4mo ago

Thank you for providing this, you are a hero!!! I'm gonna try to do cool stuff with it!

GeoAtreides 4mo ago

oh hey, per HN terms and conditions I license my HN data only to HN. Can you please remove my data from the set? Thank you!

pelagicAustral 4mo ago
You must be fun at parties
moralestapia 4mo ago
By uploading any User Content you hereby grant and will grant Y Combinator and its affiliated companies a nonexclusive, worldwide, royalty free, fully paid up, transferable, sublicensable, perpetual, irrevocable license to copy, display, upload, perform, distribute, store, modify and otherwise use your User Content for any Y Combinator-related purpose in any form, medium or technology now known or later developed. @zX41ZdbW, you can safely ignore this guy. @GeoAtreides, next time read the actual terms of service before hallucinating.
- GeoAtreides 4mo ago
  >Y Combinator and its affiliated companies is zX41ZdbW either?
  - moralestapia 4mo ago
    Oh, now I see my comment might be a bit harsh. I didn't consider you might now know about: https://github.com/hackernews/api https://github.com/hackernews/api
    - GeoAtreides 4mo ago
      yes, and per HN terms and conditions only YC and YC affiliated (as you quoted) can use the api legally. I don't license my content to anyone else and so it shouldn't be use by anyone else, even if it's available on a free-for-all API (nice move HN, btw).
      - moralestapia 4mo ago
        https://github.com/HackerNews/API/blob/master/LICENSE https://github.com/HackerNews/API/blob/master/LICENSE It's right there, you just have to click the link I shared ...
        GeoAtreides 4mo ago
        that's the license for the API, not the content/data the API serves
linmer 4mo ago
Wait, so I have to ask for every single person's permissions to use this data? uhhhhhhhhhhhhhhhhhhhhhh
snowwrestler 4mo ago
Not sure if joking, but if this product is not republishing the text of your contributions (to which you hold copyright), you’re probably not going to convince a court to do anything here. Generally speaking it is not a violation to scrape, index, and analyze web content as long as you don’t republish copyrighted content without a license, or violate access controls. For example: search engine indexes.
jrflowers 4mo ago
Steve Carrell yelling “I DECLARE BANKRUPTCY!!” in The Office dot gif
- rvba 4mo ago
  Is this GDPR territory with fines up to EUR 10 million or 2% of a company’s global annual turnover? Not sure what are the fines for some random person though

jstrieb 4mo ago

This is awesome! I do want to point out that the data in that ClickHouse playground only seems to go as far back as April 6, 2024 according to the query below: SELECT * FROM hackernews_history ORDER BY update_time ASC LIMIT 10 This is of course still extremely useful, and generous! It just wasn't obvious from the comment that this isn't querying against all Hacker News data.