You only need to copy the stuff that changed since the last time you copied stuff. If you are really generating 10TB of data more than a few times a day, you c

You only need to copy the stuff that changed since the last time you copied stuff. If you are really generating 10TB of data more than a few times a day, you can look into putting it in something like Kafka for real-time consumption by the analytics team instead of batch copying.