3 ms·

Also a fan. Usually I generate indexes/urls, and then just wget and scrape the content offline once all is downloaded.