3 ms·

I want to get away from social media noise while keeping the good recommendations you get sometimes. I'm experimenting with this blog search just to see if soci

by phgn 5y ago

I want to get away from social media noise while keeping the good recommendations you get sometimes. I'm experimenting with this blog search just to see if social comments are useful outside of the original platform. I'm glad you like the idea generally. You're right about it not being sustainable, the search really doesn't work for "non Hacker News" topics.

derekzhouzhen 5y ago
My project is somewhat similar to yours. I have a search engine too: https://roastidio.us/search https://roastidio.us/search I also offer a web based RSS reader: https://airss.roastidio.us/ https://airss.roastidio.us/ So my hope is to get people to use my RSS reader to subscribe to blogs, which can load feeds though my backend, and my backend can then index the blog posts on the side. Ranking is hard; the problem with using social media popularity to rank is that it is a lottery driven by very strong positive feedback. My search engine so far has not done any ranking.
- phgn 5y ago
  Interesting, do you see your RSS reader or the search as the main product? Have you thought about getting RSS feeds e.g. from the Common Crawl [0]? Social media attention is highly asymmetric, but I'm not sure what else to use as filter. There's so too much information otherwise, especially if considering old blog posts. False negatives are the cost for getting more signal. [0] https://commoncrawl.org https://commoncrawl.org
  - derekzhouzhen 5y ago
    The RSS reader, the search and commenting platform are all parts of the idea that to make blogs more accessible and more discoverable while protecting the privacy of readers and writers. commoncrawl has too much data and it is pretty hard to sift through. I will stick with the current sources for now. BTW, if you want to implement user commenting, maybe you can leverage my platform.

3 ms·

I want to get away from social media noise while keeping the good recommendations you get sometimes. I'm experimenting with this blog search just to see if soci

by phgn 5y ago

derekzhouzhen 5y ago
My project is somewhat similar to yours. I have a search engine too: https://roastidio.us/search https://roastidio.us/search I also offer a web based RSS reader: https://airss.roastidio.us/ https://airss.roastidio.us/ So my hope is to get people to use my RSS reader to subscribe to blogs, which can load feeds though my backend, and my backend can then index the blog posts on the side. Ranking is hard; the problem with using social media popularity to rank is that it is a lottery driven by very strong positive feedback. My search engine so far has not done any ranking.
- phgn 5y ago
  Interesting, do you see your RSS reader or the search as the main product? Have you thought about getting RSS feeds e.g. from the Common Crawl [0]? Social media attention is highly asymmetric, but I'm not sure what else to use as filter. There's so too much information otherwise, especially if considering old blog posts. False negatives are the cost for getting more signal. [0] https://commoncrawl.org https://commoncrawl.org
  - derekzhouzhen 5y ago
    The RSS reader, the search and commenting platform are all parts of the idea that to make blogs more accessible and more discoverable while protecting the privacy of readers and writers. commoncrawl has too much data and it is pretty hard to sift through. I will stick with the current sources for now. BTW, if you want to implement user commenting, maybe you can leverage my platform.