Nothing wrong with that. That's how I've built scraper systems in the past. It's nice for getting historical snapshots of live data. The trouble comes in when

Nothing wrong with that. That's how I've built scraper systems in the past. It's nice for getting historical snapshots of live data. The trouble comes in when you want to do something that you know will modify the result. (The "request things that need updating" part was surprisingly hard for me; if an item is modified but the old cached copy is still being served, it became problematic for me to rely on it.)