4 ms·

Every time I want to track some news source (or software release list) and that source offers no RSS/Atom feed, I add that missing feed myself. For example, I

Every time I want to track some news source (or software release list) and that source offers no RSS/Atom feed, I add that missing feed myself. For example, I wrote a feed generator that targets a specific software package release page. It scrapes the page and converts it to an Atom feed [1]. I then wrote a matching systemd service, which triggers the scraper once a day [2] and writes it to a file, no hosting required. My RSS reader is pointed to that file. [1]: https://github.com/claui/release-feed-mediola/blob/fca39e897b5a664d589ed3b45b28500a3bd9a4ee/release_feed_mediola/api.py#L87-L104 https://github.com/claui/release-feed-mediola/blob/fca39e897... [2]: https://github.com/claui/release-feed-mediola/blob/fca39e897b5a664d589ed3b45b28500a3bd9a4ee/contrib/systemd/release-feed-mediola%40.service https://github.com/claui/release-feed-mediola/blob/fca39e897...

ulrischa 3y ago
Read last week, that freshrss has a new scraping feature: https://danq.me/2022/09/27/freshrss-xpath/ https://danq.me/2022/09/27/freshrss-xpath/
captn3m0 3y ago
These would be nice contributions to rss bridge.
Vinnl 3y ago
I created [1]: you put a couple of CSS selectors into a config file, push it up to GitHub, and then GitHub actions will run twice a day to update the feed, and host it on GitHub Pages. [1] https://feed-me-up-scotty.vincenttunru.com/ https://feed-me-up-scotty.vincenttunru.com/
- gabereiser 3y ago
  oh this is really cool. It requires zero infrastructure on the user's part (just a github repo) and does exactly what it advertises. Great job. I'm going to start using this.
remram 3y ago
Fortunately Git tags are almost as good as RSS entries, it is easy to get a list of versions from somebody as long as they are creating tags in a Git repo. There is not usually support in reader software though, so a little scripting is still required, unless they use a Git hosting platform that exposes those as RSS (GitHub and GitLab do).
kornhole 3y ago
That is cool for a local feed. Have you tried it on a server? I am able to get a lot of generally unavailable feeds using https://github.com/RSS-Bridge/rss-bridge https://github.com/RSS-Bridge/rss-bridge running on my server. Perhaps this code could be someday brought in as a catch-all last resort.
- Hackbraten 3y ago
  > Have you tried it on a server? Good question. Maintaining a server feels like a chore to me, nor am I willing to pay for cloud services as long as a local Python script (plus systemd unit plus PKGBUILD) will do. Besides, this particular target site is extremely niche. So I figure it’s probably not worth the burden to port my code and contribute it to rss-bridge, let alone for the upstream folks to maintain it.

ulrischa 3y ago

Read last week, that freshrss has a new scraping feature: https://danq.me/2022/09/27/freshrss-xpath/ https://danq.me/2022/09/27/freshrss-xpath/

captn3m0 3y ago

These would be nice contributions to rss bridge.

Vinnl 3y ago

I created [1]: you put a couple of CSS selectors into a config file, push it up to GitHub, and then GitHub actions will run twice a day to update the feed, and host it on GitHub Pages. [1] https://feed-me-up-scotty.vincenttunru.com/ https://feed-me-up-scotty.vincenttunru.com/

gabereiser 3y ago
oh this is really cool. It requires zero infrastructure on the user's part (just a github repo) and does exactly what it advertises. Great job. I'm going to start using this.

remram 3y ago

Fortunately Git tags are almost as good as RSS entries, it is easy to get a list of versions from somebody as long as they are creating tags in a Git repo. There is not usually support in reader software though, so a little scripting is still required, unless they use a Git hosting platform that exposes those as RSS (GitHub and GitLab do).

kornhole 3y ago

That is cool for a local feed. Have you tried it on a server? I am able to get a lot of generally unavailable feeds using https://github.com/RSS-Bridge/rss-bridge https://github.com/RSS-Bridge/rss-bridge running on my server. Perhaps this code could be someday brought in as a catch-all last resort.

Hackbraten 3y ago
> Have you tried it on a server? Good question. Maintaining a server feels like a chore to me, nor am I willing to pay for cloud services as long as a local Python script (plus systemd unit plus PKGBUILD) will do. Besides, this particular target site is extremely niche. So I figure it’s probably not worth the burden to port my code and contribute it to rss-bridge, let alone for the upstream folks to maintain it.