3 ms·
Offtopic, but currious what are your use cases when searching all HN and reddit comments? Im at the beggining of this path, just crawled HN, but what to do with
by vincnetas 5y ago
Offtopic, but currious what are your use cases when searching all HN and reddit comments? Im at the beggining of this path, just crawled HN, but what to do with this, still a bit cloudy.
- lettergram 5y agoI built a search engine that quantified the expertise of authors of comments. Then I created what I called “expert rank” that allowed me to build a really good search engine. Super good if you’re at a company or something https://twitter.com/austingwalters/status/1041894765439201281?s=21 https://twitter.com/austingwalters/status/104189476543920128...
- turbocon 5y agoWow, that lead me down quite a rabbit hole, impressive work.
- busymom0 5y agoIf you are just interested in searching HN and don't need full data dumps, the Algolia search for HN is quite good and fast: https://hn.algolia.com https://hn.algolia.com They also have a free API. If you need data dumps, maybe look into Google BigQuery.