3 ms·
I started with the contents of my own RSS feed, and then crawled Hacker News for popular blogs, and then crawled the feeds of those blogs (in order to get posts
by BillFranklin 6y ago
I started with the contents of my own RSS feed, and then crawled Hacker News for popular blogs, and then crawled the feeds of those blogs (in order to get posts that didn't get upvoted on HN).
The time consuming part was manually auditing blogs for quality (and to ensure it's a personal blog, not e.g. a BBC feed). I came up with some heuristics (i.e. blogs with github.io subdomains that got upvoted were often good so I blanket approved those) to speed things along, but it did take a while.
- taoothereporter 6y agoHave you tried to apply some ML stuff?
- BillFranklin 6y agoBack in August I had a look at using Latent Dirichlet Allocation (http://blog.echen.me/2011/08/22/introduction-to-latent-dirichlet-allocation/ http://blog.echen.me/2011/08/22/introduction-to-latent-diric...) for improving how I auto-tag articles. It looked promising but I haven't deployed it yet. There are various recommendation approaches I'd like to try. If the site had more users (beyond the ~4 friends I showed it to) I'd like to try out a collaborative filtering approach (https://en.wikipedia.org/wiki/Collaborative_filtering https://en.wikipedia.org/wiki/Collaborative_filtering).
- swsieber 6y agoI took a course about bayesian stats and ML in college. We covered LDA. It's pretty awesome! I hope you can get it out and that it goes well.
- djhn 6y agoThis would make for an interesting... technical blog post.