3 ms·
Looks good! How much is something like this going to cost you? Asking because my immediate thought was that these types of projects usually get their lights tu
by skilled 2y ago
Looks good! How much is something like this going to cost you?
Asking because my immediate thought was that these types of projects usually get their lights turned off rather quickly because of costs.
What is your source for the feeds?
- alastairr 2y agoright now the biggest cost is llm api calls (currently claude haiku) for organising content and making it easily searchable - this is relatively cheap (max 50$ per month). I use pinecone for search which so far has been very inexpensive, though admittedly traffic has been low, so I'll see how that goes. on feeds - I've built a list over a number of years, a mix of tracking blogs on twitter, hacker news and a few other places. usually the feed url can be lifted quite easily from a blog's header.
- skilled 2y agoUgh, let me rephrase the question then, is this 34,000 blogs as in websites, or blogs as in posts? I assumed the former, but sounds like I might have been wrong since building a list of 34k niche websites would be next to impossible. I am guessing you have added everything from here: https://news.ycombinator.com/item?id=36575081 https://news.ycombinator.com/item?id=36575081 and the subsequent site that offers the OPML for those blogs: https://dm.hn/ https://dm.hn/
- alastairr 2y agoYes, it's 34k websites, but to be transparent, they probably don't all strictly qualify as niche, for example, it includes some smaller commercial sites (usually if they have tech blogs). I've found the hardest part of this isn't finding the feeds so much as filtering out the usual suspects (SEO etc) that masquerade as technical content. As well as HN, I found a google search along the lines of "site:github.com opml rss feed [topic]" was quite effective too.