2 ms·
one specific solution: If your code downloads web content (e.g. a scraper), and you want to avoid having to re-download when you restart it, the requests_cache
by KerrickStaley 8y ago
one specific solution: If your code downloads web content (e.g. a scraper), and you want to avoid having to re-download when you restart it, the requests_cache module [1] works really well.
Also echoing thaw13579's comment; I used GNU Make in one project [2] for this and it worked OK.
[1] https://github.com/reclosedev/requests-cache https://github.com/reclosedev/requests-cache
[2] https://github.com/kerrickstaley/tatoeba_rank/blob/master/Makefile https://github.com/kerrickstaley/tatoeba_rank/blob/master/Ma...