Try maintaining a backup of a bucket with tens of millions of objects that are constantly changing. Not such a trivial or cheap problem to solve now. Downloadin

Try maintaining a backup of a bucket with tens of millions of objects that are constantly changing. Not such a trivial or cheap problem to solve now. Downloading the bucket listing alone can take hours. Btw if anyone has any suggestions I'd love to hear them. So far the best approaches seem to be either to upload to multiple providers in the first place or to organise the buckets in such a way that bucket listings are not required to copy all files changed since a certain date.