3 ms·

Hello HN, This was a small project of mine after I've found out that I can simply the whole hackernews archive (~48GB) and play around with it. You can compar

Hello HN, This was a small project of mine after I've found out that I can simply the whole hackernews archive (~48GB) and play around with it. You can compare terms just like in google trends and you can also see the exact posts & comments from that time. I like that you can discover what went crazy in the timeline, they just come up as small burst of activity, it's quite fun to play around with it. https://hackernewstrends.com/?q=litecoin&q=dogecoin&q=solana&from=1512345600000&to=1514937600000 https://hackernewstrends.com/?q=litecoin&q=dogecoin&q=solana... I also have a seperate page for the "Who is Hiring?" posts, here is the distribution of programming languages over each monthly "Who is hiring?" post in HN ever. https://hackernewstrends.com/who-is-hiring https://hackernewstrends.com/who-is-hiring Any kind of feedback is welcome.

jupr 3mo ago
Honestly the HN archive is very valuable. If you had it all on a local db with everything indexed you basically end up with a offline search engine. Where is this archive located you speak of?
- fragmede 3mo ago
  It's on firebase, per https://github.com/hackernews/api https://github.com/hackernews/api
- jupr 3mo ago
  found : https://huggingface.co/datasets/open-index/hacker-news https://huggingface.co/datasets/open-index/hacker-news
cbeach 3mo ago
This is excellent. A minor suggestion - I'd like to be able to render the current graph taller (full height of my browser window). Also some sentiment analysis on the "people" graphs would be very insightful (particularly for the likes of Edward Snowdon, Julian Assange, Elon Musk and Sam Altman). Perhaps colour the area under the graph red-orange-green based on the sentiment?
- ytkimirti 3mo ago
  Thanks for the feedback, noted the full-screen request. The sentiment analysis is very interesting, I can do that easily. Could be a new page as well. Did you see this anywhere else or just your idea?
  - cbeach 3mo ago
    Just my idea. I'm working on a side project https://newsavista.com/invite/ASAD68923E https://newsavista.com/invite/ASAD68923E that aggregates news and tracks news trends and changing sentiment on the major stories. With cheap cloud LLMs (and "free" local LLMs) it turns out to be a trivial feature to build.
omoikane 3mo ago
> https://hackernewstrends.com/who-is-hiring https://hackernewstrends.com/who-is-hiring Currently it says "no job-post mentions in this window" for everything. Transient error?
aaron695 3mo ago
[dead]

jupr 3mo ago

Honestly the HN archive is very valuable. If you had it all on a local db with everything indexed you basically end up with a offline search engine. Where is this archive located you speak of?

fragmede 3mo ago
It's on firebase, per https://github.com/hackernews/api https://github.com/hackernews/api
jupr 3mo ago
found : https://huggingface.co/datasets/open-index/hacker-news https://huggingface.co/datasets/open-index/hacker-news

cbeach 3mo ago

This is excellent. A minor suggestion - I'd like to be able to render the current graph taller (full height of my browser window). Also some sentiment analysis on the "people" graphs would be very insightful (particularly for the likes of Edward Snowdon, Julian Assange, Elon Musk and Sam Altman). Perhaps colour the area under the graph red-orange-green based on the sentiment?

ytkimirti 3mo ago
Thanks for the feedback, noted the full-screen request. The sentiment analysis is very interesting, I can do that easily. Could be a new page as well. Did you see this anywhere else or just your idea?
- cbeach 3mo ago
  Just my idea. I'm working on a side project https://newsavista.com/invite/ASAD68923E https://newsavista.com/invite/ASAD68923E that aggregates news and tracks news trends and changing sentiment on the major stories. With cheap cloud LLMs (and "free" local LLMs) it turns out to be a trivial feature to build.

omoikane 3mo ago

> https://hackernewstrends.com/who-is-hiring https://hackernewstrends.com/who-is-hiring Currently it says "no job-post mentions in this window" for everything. Transient error?

aaron695 3mo ago

[dead]