3 ms·
No feed? No problem. My go-to tool for sites without rss is http://feed43.com http://feed43.com which I find easy to set up. Also important to point out that
by Sukotto 15y ago
No feed? No problem.
My go-to tool for sites without rss is http://feed43.com http://feed43.com which I find easy to set up. Also important to point out that it plays nice with the sites it scrapes.
Example... Problem: I love lurking in ask.metafilter but only want to see threads that have a "best answer" marked. No official feed for that.
Solution: http://feed43.com/2602451534003772.xml http://feed43.com/2602451534003772.xml
Problem: I really like the PS238 comic but there's no direct feed
Solution: http://feed43.com/ps238-link-only.xml http://feed43.com/ps238-link-only.xml
Another tool that looks promising but I haven't really dug into yet is http://scraperwiki.com http://scraperwiki.com (pardon the pun)
- lordgilman 15y agoI'm also a huge fan of feed43 but I've managed to hit my head more than a few times on its limitations. Coincidentally just this weekend I wrote a teeny program as a replacement for feed43. I've got all my scrapers working with XPath (which I prefer for this situation) but it's very straightforward to add a new site. https://github.com/dgilman/atom_maker https://github.com/dgilman/atom_maker