2 ms·

Scrape it

• ivan_ah 13y ago
  Surely there's a better way than hitting the HN servers O(7169040) times... Does anyone have an old scrape they can post somewhere or as a torrent? Note, for my purposes bag-of-words (i.e. word counts) would be enough.
  • rahimnathwani 13y ago
    bag-of-words (i.e. word counts) would be enough Are you doing sentiment analysis?
    • ivan_ah 13y ago
      Sorry for the delay in replying: I didn't see your comment. I'm working on topic modelling (Latent Dirichlet Allocation in particular). It's for a business, but I also want to solve one of my problems: reading HN addiction ;)
  • tptacek 13y ago
    I think you just suggested that scraping HN was a constant time operation.
    • deleted 13y ago
      [deleted]
• GrahamsNumber 13y ago
  10/10 would scrape