4 ms·
I read a lot of "serial archive"-formatted things (webcomics, online novels, etc.) I've always wanted an extension like this that will spider rel="next" and rel
by derefr 10y ago
I read a lot of "serial archive"-formatted things (webcomics, online novels, etc.) I've always wanted an extension like this that will spider rel="next" and rel="previous" links/headers (or, not finding those, try to guess a pair of links on the page that represent those) to build up an archive sequence; chew that into a set of pages+sections; generate a Table of Contents for those; and then stick all that together into an ePub.
I've written scrapers to do exactly that for a few works, but they're one-offs that get their metadata (e.g. chapter titles) from explicit provided data-structures rather than from the site itself. A fully-general solution to this would be amazing.
- lfowles 10y agoHave you seen Dosage? It supports a lot of webcomics, but I don't remember how general it was. (Edit: I missed that you finished by publishing the content as an epub) http://dosage.rocks/ http://dosage.rocks/
- derefr 10y agoDosage seems to be more like a pseudo-RSS-client that relies on scraping cronjobs (for following live content that doesn't have an RSS feed; somewhat like what Dapper used to do) rather than a batch site-mirror-to-single-document transformer. I want this extension not for the new pages just coming out now, but rather to more comfortably go through the ten years of pages of something that have already built up (on my phone with a reflowed mobile layout†, and still available when offline.) Side-note: webcomic authors have realized that there's a market for physical book-prints of their work, but they're ignoring the fact that people like me would gladly buy a digital version of the same book from the Kindle or iBooks store—even though we can read the individual pages online. People are willing to pay for convenience! † And speaking of reflowed mobile layouts, I wish every webcomic reflowed the way Dinosaur Comics does (http://qwantz.com/index.php?mobile=1 http://qwantz.com/index.php?mobile=1). It wouldn't work for those special "frame-boundary-breaking" art techniques, but most comics don't even use those.
- rahimnathwani 10y agoCalibre recipes can do this. You still need to specify the start page, xpath to get the chapters etc., but it works.