From personal experience with a HN headline scraping IRC bot I wrote a few years ago, 400 labelled headlines is more than sufficient to get pretty good results.

From personal experience with a HN headline scraping IRC bot I wrote a few years ago, 400 labelled headlines is more than sufficient to get pretty good results. The threshold of usefulness should be closer to a few dozen rankings.