4 ms·
A friend and I made a tool/framework to easily create RSS feeds for websites that don't offer one. It's written in Python and uses Scrapy for scraping the websi
by superwayne 9y ago
A friend and I made a tool/framework to easily create RSS feeds for websites that don't offer one. It's written in Python and uses Scrapy for scraping the website. Maybe it could be helpful to somebody. Out of the box mostly Austrian sites are supported but adding a new site usually involves only a few lines of code.
http://github.com/nblock/feeds http://github.com/nblock/feeds
- onli 9y agoIf the site is simple enough, one could also use my Yahoo Pipes revival project[0] to extract content from a page into an RSS feed. [0]: https://www.pipes.digital/ https://www.pipes.digital/
- amiraliakbari 9y agoThe sites seems somehow immature to me. The "Shared Pipes" sections lists a few examples, but the first one returns an empty feed and the second one returns "Internal Server Error". It is probably because of the definition of the pipes being outdated, but it needs better presentation.
- onli 9y agoHi, thanks for the feedback. The first pipe is filtering for crypto currency articles on HN, right now there seems to be none with those exact keywords, I'll add some more. The second is user-provided and probably dies because of the sub-pipe, I removed my upvote - now the second one is https://www.pipes.digital/pipe/kGqKVPOx https://www.pipes.digital/pipe/kGqKVPOx, which works fine. In general I tried to keep backwards compatiblity as much as possible, I'm only aware of one single breaking change (filter via regexpression, which was not possible for long before the syntax changed and should not have affected many pipes).