3 ms·
There's an open source service that does something similar, does anyone remember its name? edit: Both rssbox in the OP, and RSS-bridge[1] are open source. I wa
by heavyset_go 6y ago
There's an open source service that does something similar, does anyone remember its name?
edit: Both rssbox in the OP, and RSS-bridge[1] are open source. I was thinking of the latter. There's also RSSHub[2].
[1] https://github.com/RSS-Bridge/rss-bridge https://github.com/RSS-Bridge/rss-bridge
[2] https://github.com/DIYgod/RSSHub https://github.com/DIYgod/RSSHub
- hombre_fatal 6y agoThere's https://easylist.to/easylist/easylist.txt https://easylist.to/easylist/easylist.txt for universal content-blocking rules, youtube-dl for universal video extraction methods. While building a feed reader of my own, I had a recent idea for a project for universal content crawling rules: how is the content hierarchy organized on each site and how do you extract it from each content page. A single community project that any other project could use to crawl websites for their content. Looks like rss-bridge comes close to that.
- k1m 6y agoTo help extract article content, you might be interested in this collection I help maintain: https://github.com/fivefilters/ftr-site-config/ https://github.com/fivefilters/ftr-site-config/ It's used, in addition to an automatic article extractor, in Full-Text RSS: http://ftr.fivefilters.org http://ftr.fivefilters.org
- pabs3 6y agoThere is also tweeper: https://ao2.it/en/blog/2013/07/07/tweeper-twitter-rss-web-scraper https://ao2.it/en/blog/2013/07/07/tweeper-twitter-rss-web-sc...