Building datasets up via migration sets, not manual updates, and storing source data will solve both of those issues. If you also need fresh data, store snapsho

Building datasets up via migration sets, not manual updates, and storing source data will solve both of those issues. If you also need fresh data, store snapshots which you should be doing anyway. Shortly put, with a thought out approach I don't see this as a bigger issue than anything else on the list.