3 ms·

Excuse me for technical illiteracy, but would that make sense to export these snapshots daily? Is there any way to consistently get the (every 24h) data from t

by giseir 7y ago

Excuse me for technical illiteracy, but would that make sense to export these snapshots daily? Is there any way to consistently get the (every 24h) data from the database in S3?

giseir 7y ago
Let’s say I have a database with 1TB of data. I export it daily to S3 with this Snapshot export. Does it mean I will be adding 1TB every day to my S3 storage?
- HatchedLake721 7y ago
  Yes
  - giseir 7y ago
    Thanks, now I understand it. Then it makes sense to delete the earlier snapshot and only keep the latest one to not store redundant data.
    - jungturk 7y ago
      You can also use the CDC features of AWS Data Migration Service to just get incrementals (also in parquet if preferred) rather than full snapshots. https://aws.amazon.com/blogs/database/aws-dms-now-supports-native-cdc-support/ https://aws.amazon.com/blogs/database/aws-dms-now-supports-n...