16 ms·

RssHub – A feed aggregator that can generate feeds from pretty much everything

235 points by tvvocold 8y ago

aiNohY6g 8y ago
See also https://github.com/RSS-Bridge/ https://github.com/RSS-Bridge/
- zaarn 8y ago
  Interestingly, they have bridges for some websites that do have RSS feeds (Steam, Youtube and HN)... Maybe because the feeds are hard to find?
  - wccrawford 8y ago
    Or perhaps those feeds are deficient in some way. Maybe they update later than the actual site, or have ads inserted as if they are articles.
    - zaarn 8y ago
      Neither of those three do that to my knowledge. Well, given Steam is basically 90% just announcements for deals and HN is an endless spam of articles that were on the frontpage for a millisecond, but I think that would be given.
  - Aelius 8y ago
    I use YouTube RSS and the most annoying thing is that it doesn't use the conventional date stamp, which is very annoying. That's a problem worth fixing.
    - zaarn 8y ago
      Humm, I don't think I had this be a problem. Likely TTRSS ignores this issue and/or just parses the timestamp until numbers come out.
  - ino 8y ago
    YouTube used to have an open feed for any search term, but they took it away. This seems to have search but I don't know if you need to authenticate first.
- hugh4life 8y ago
  I use RSS Bridge and a couple other services(twitrss.me from the top of my head) and the only thing this has that I'm missing is github trending projects.
deleted 8y ago
[deleted]
rhabarba 8y ago
See also https://bitbucket.org/tux_/rssparser.lisp https://bitbucket.org/tux_/rssparser.lisp (disclosure: mine).
captn3m0 8y ago
I was so happy at seeing telegram, but it requires admin rights to the channel. There is so much content (a lot of it non-english) hidden away in telegram channels that I want to be part of the open web. If someone wants to take it up, it is definitely doable with a telegram user account, but the APIs are not readily usable: https://github.com/captn3m0/ideas#telegram-to-rss https://github.com/captn3m0/ideas#telegram-to-rss Also, if someone is looking to follow lots of GitHub projects using their release feeds, I wrote a OPML generator that uses your Starred repos to generate a OPML file for you: https://github.com/captn3m0/opml-gen https://github.com/captn3m0/opml-gen
- solarkraft 8y ago
  I believe that it might be against Telegram's ToS to scrape channels (Update: It doesn't seem to be). That said: I too really like the idea. I had been thinking about writing a tool to scrape Telegram channels for another project, but found tg-cli with its Lua, Python bindings and weird command line interface to be quite messy (so I gave up for then). Since this seems to be in decent demand, surely somebody has already written a tool for this?
  - captn3m0 8y ago
    I tried tg-cli and a few mtproto compatible libraries, but it was all a huge pain to get working properly before I gave up: https://github.com/captn3m0/opengram https://github.com/captn3m0/opengram The good APIs are the bot ones which won't work here.
- disiplus 8y ago
  telegram has this shitty feature where if anybody knows your public username they can add you to any group they want. this is the source of the shitty spam on telegram right now. i was active in the crypto space and my username leaked. im now added to ton of spam and pump groups daily and i cannot block it. also you dont need admin rights to the channel, but you have to work with https://core.telegram.org/mtproto https://core.telegram.org/mtproto to scrape channels. i did some side project with this https://github.com/zerobias/telegram-mtproto https://github.com/zerobias/telegram-mtproto
k1m 8y ago
I work on Feed Creator which might be interesting too: http://createfeed.fivefilters.org http://createfeed.fivefilters.org
staz 8y ago
My mind read that as RSS + SSH and started wondering what funny thing that could do...
superwayne 8y ago
Link to GitHub: https://github.com/DIYgod/RSSHub https://github.com/DIYgod/RSSHub
cyborgx7 8y ago
How come noone has managed to crack the RSS rock yet? Everything has an RSS feed (though it's decreasing). Rss readers have more content than any social network. It seems like you should be able to build something with this that has broad adoption. There has to be something missing. My theory has been for a while that what is missing is publishing. People don't just want to consume, they also want to share what they find and like and what they made themselves. I even started working on a web-based rss-reader/(micro)blogging thing at one point. Maybe I should give that another crack.
- older 8y ago
  Isn't ActivityPub supposed to fill the gap?
  - rakoo 8y ago
    Yeah its predecessor, OStatus, was pretty much that: you start with a feed of anything, then you add another feed for the reader to comment, then a way to send the comment back to the source so everyone can see it, and lo and behold you've got yourself a social network brewing. Activitypub is a rethinking of the whole thing with clear requirements and specs instead of some informal pieces added here and there, which is a good thing. Except all the existing RSS feeds can't be used as such.
- grumph 8y ago
  If you don't know it, take a look at Shaarli[1], it's a bookmarking web app that allows you to share your bookmarks via RSS, you can add tags and comments, but you can also have "notes" without a link that can be used as microblogging posts. It's a project from Sebsauvage[2] (an old school french blogger), who wanted to build a social network around the RSS technology. I know there are projects around it to aggregate multiple shaarli and use it as an actual social network based around sharing links with RSS. I didn't search about it, but it seems that shaarlo[3] is one of them. EDIT: actually, projects like this are listed in shaarli's documentation[4]. EDIT2: tt-rss-shaarli seems to be what you want, Tiny-Tiny RSS with Shaarli, an aggregator with a sharing/commenting functionality. [1] https://github.com/shaarli/Shaarli https://github.com/shaarli/Shaarli [2] http://sebsauvage.net/wiki/doku.php?id=php:shaarli http://sebsauvage.net/wiki/doku.php?id=php:shaarli [3] https://github.com/DMeloni/shaarlo https://github.com/DMeloni/shaarlo [4] https://shaarli.readthedocs.io/en/master/Community-&-Related-software/ https://shaarli.readthedocs.io/en/master/Community-&-Related...
h43z 8y ago
This python script https://github.com/h43z/rssify https://github.com/h43z/rssify serves me well to get and RSS feed for websites that don't provide one.
- rhabarba 8y ago
  It has a lot of dependencies though. (You might also like mine which can be compiled into a portable binary with one extra line of code. ;-))
ccnafr 8y ago
Oh... another service similar to Page2RSS that will die in 6 months. Sign me right up :[
- WaltPurvis 8y ago
  Looks to me like it's a service you can deploy on your own server.
joaomsa 8y ago
Nice companion to: http://fetchrss.com/ http://fetchrss.com/
amelius 8y ago
Does it support Facebook group posts?
- omerbensaadon 8y ago
  I would like to know this as well!
ajaygeorge91 8y ago
exactly what i was looking for
jim-jim-jim 8y ago
This is much appreciated for twitter, which is astoundingly over-engineered for a site about little blurbs of text.
entropie 8y ago
I don't understand exactly what this software does. The demo link on the frontpage leads to a welcome page. The site is very uninformative but looks very bloated.
sonnhy 8y ago
Is there a RSS generator for Facebook pages as well? Will this support Facebook pages later on?
- rodorgas 8y ago
  Facebook used to have a RSS feed, but was shutdown: it's not interesting to Facebook that users spent less time on their plataform. AFAIK RSS feed are currently only supported by https://fetchrss.com/ https://fetchrss.com/, but it's paid or ad-based.
- nreece 8y ago
  You can create Facebook (and Instagram, Twitter) feeds with Feedity - https://feedity.com https://feedity.com
smpetrey 8y ago
Neat! Now if it could only RSS-ify literally anything this could be useful.
nreece 8y ago
This looks great! * Shameless plug *: Our little startup, Feedity - https://feedity.com https://feedity.com, helps create custom RSS feeds for any webpage, even social networks (Facebook, Instagram, Twitter), via an online feed builder and REST API.

235 points by tvvocold 8y ago

aiNohY6g 8y ago

See also https://github.com/RSS-Bridge/ https://github.com/RSS-Bridge/

zaarn 8y ago
Interestingly, they have bridges for some websites that do have RSS feeds (Steam, Youtube and HN)... Maybe because the feeds are hard to find?
- wccrawford 8y ago
  Or perhaps those feeds are deficient in some way. Maybe they update later than the actual site, or have ads inserted as if they are articles.
  - zaarn 8y ago
    Neither of those three do that to my knowledge. Well, given Steam is basically 90% just announcements for deals and HN is an endless spam of articles that were on the frontpage for a millisecond, but I think that would be given.
- Aelius 8y ago
  I use YouTube RSS and the most annoying thing is that it doesn't use the conventional date stamp, which is very annoying. That's a problem worth fixing.
  - zaarn 8y ago
    Humm, I don't think I had this be a problem. Likely TTRSS ignores this issue and/or just parses the timestamp until numbers come out.
- ino 8y ago
  YouTube used to have an open feed for any search term, but they took it away. This seems to have search but I don't know if you need to authenticate first.
hugh4life 8y ago
I use RSS Bridge and a couple other services(twitrss.me from the top of my head) and the only thing this has that I'm missing is github trending projects.

deleted 8y ago

[deleted]

rhabarba 8y ago

See also https://bitbucket.org/tux_/rssparser.lisp https://bitbucket.org/tux_/rssparser.lisp (disclosure: mine).

captn3m0 8y ago

I was so happy at seeing telegram, but it requires admin rights to the channel. There is so much content (a lot of it non-english) hidden away in telegram channels that I want to be part of the open web. If someone wants to take it up, it is definitely doable with a telegram user account, but the APIs are not readily usable: https://github.com/captn3m0/ideas#telegram-to-rss https://github.com/captn3m0/ideas#telegram-to-rss Also, if someone is looking to follow lots of GitHub projects using their release feeds, I wrote a OPML generator that uses your Starred repos to generate a OPML file for you: https://github.com/captn3m0/opml-gen https://github.com/captn3m0/opml-gen

solarkraft 8y ago
I believe that it might be against Telegram's ToS to scrape channels (Update: It doesn't seem to be). That said: I too really like the idea. I had been thinking about writing a tool to scrape Telegram channels for another project, but found tg-cli with its Lua, Python bindings and weird command line interface to be quite messy (so I gave up for then). Since this seems to be in decent demand, surely somebody has already written a tool for this?
- captn3m0 8y ago
  I tried tg-cli and a few mtproto compatible libraries, but it was all a huge pain to get working properly before I gave up: https://github.com/captn3m0/opengram https://github.com/captn3m0/opengram The good APIs are the bot ones which won't work here.
disiplus 8y ago
telegram has this shitty feature where if anybody knows your public username they can add you to any group they want. this is the source of the shitty spam on telegram right now. i was active in the crypto space and my username leaked. im now added to ton of spam and pump groups daily and i cannot block it. also you dont need admin rights to the channel, but you have to work with https://core.telegram.org/mtproto https://core.telegram.org/mtproto to scrape channels. i did some side project with this https://github.com/zerobias/telegram-mtproto https://github.com/zerobias/telegram-mtproto

k1m 8y ago

I work on Feed Creator which might be interesting too: http://createfeed.fivefilters.org http://createfeed.fivefilters.org

staz 8y ago

My mind read that as RSS + SSH and started wondering what funny thing that could do...

superwayne 8y ago

Link to GitHub: https://github.com/DIYgod/RSSHub https://github.com/DIYgod/RSSHub

cyborgx7 8y ago

How come noone has managed to crack the RSS rock yet? Everything has an RSS feed (though it's decreasing). Rss readers have more content than any social network. It seems like you should be able to build something with this that has broad adoption. There has to be something missing. My theory has been for a while that what is missing is publishing. People don't just want to consume, they also want to share what they find and like and what they made themselves. I even started working on a web-based rss-reader/(micro)blogging thing at one point. Maybe I should give that another crack.

older 8y ago
Isn't ActivityPub supposed to fill the gap?
- rakoo 8y ago
  Yeah its predecessor, OStatus, was pretty much that: you start with a feed of anything, then you add another feed for the reader to comment, then a way to send the comment back to the source so everyone can see it, and lo and behold you've got yourself a social network brewing. Activitypub is a rethinking of the whole thing with clear requirements and specs instead of some informal pieces added here and there, which is a good thing. Except all the existing RSS feeds can't be used as such.
grumph 8y ago
If you don't know it, take a look at Shaarli[1], it's a bookmarking web app that allows you to share your bookmarks via RSS, you can add tags and comments, but you can also have "notes" without a link that can be used as microblogging posts. It's a project from Sebsauvage[2] (an old school french blogger), who wanted to build a social network around the RSS technology. I know there are projects around it to aggregate multiple shaarli and use it as an actual social network based around sharing links with RSS. I didn't search about it, but it seems that shaarlo[3] is one of them. EDIT: actually, projects like this are listed in shaarli's documentation[4]. EDIT2: tt-rss-shaarli seems to be what you want, Tiny-Tiny RSS with Shaarli, an aggregator with a sharing/commenting functionality. [1] https://github.com/shaarli/Shaarli https://github.com/shaarli/Shaarli [2] http://sebsauvage.net/wiki/doku.php?id=php:shaarli http://sebsauvage.net/wiki/doku.php?id=php:shaarli [3] https://github.com/DMeloni/shaarlo https://github.com/DMeloni/shaarlo [4] https://shaarli.readthedocs.io/en/master/Community-&-Related-software/ https://shaarli.readthedocs.io/en/master/Community-&-Related...

h43z 8y ago

This python script https://github.com/h43z/rssify https://github.com/h43z/rssify serves me well to get and RSS feed for websites that don't provide one.

rhabarba 8y ago
It has a lot of dependencies though. (You might also like mine which can be compiled into a portable binary with one extra line of code. ;-))

ccnafr 8y ago

Oh... another service similar to Page2RSS that will die in 6 months. Sign me right up :[

WaltPurvis 8y ago
Looks to me like it's a service you can deploy on your own server.

joaomsa 8y ago

Nice companion to: http://fetchrss.com/ http://fetchrss.com/

amelius 8y ago

Does it support Facebook group posts?

omerbensaadon 8y ago
I would like to know this as well!

ajaygeorge91 8y ago

exactly what i was looking for

jim-jim-jim 8y ago

This is much appreciated for twitter, which is astoundingly over-engineered for a site about little blurbs of text.

entropie 8y ago

I don't understand exactly what this software does. The demo link on the frontpage leads to a welcome page. The site is very uninformative but looks very bloated.

sonnhy 8y ago

Is there a RSS generator for Facebook pages as well? Will this support Facebook pages later on?

rodorgas 8y ago
Facebook used to have a RSS feed, but was shutdown: it's not interesting to Facebook that users spent less time on their plataform. AFAIK RSS feed are currently only supported by https://fetchrss.com/ https://fetchrss.com/, but it's paid or ad-based.
nreece 8y ago
You can create Facebook (and Instagram, Twitter) feeds with Feedity - https://feedity.com https://feedity.com

smpetrey 8y ago

Neat! Now if it could only RSS-ify literally anything this could be useful.

nreece 8y ago

This looks great! * Shameless plug *: Our little startup, Feedity - https://feedity.com https://feedity.com, helps create custom RSS feeds for any webpage, even social networks (Facebook, Instagram, Twitter), via an online feed builder and REST API.