4 ms·

Can anyone recommend a Google Drive backup to something like AWS S3 Glacier or other long-term storage provider? I was running BorgBase but had some financial d

Can anyone recommend a Google Drive backup to something like AWS S3 Glacier or other long-term storage provider? I was running BorgBase but had some financial difficulties and couldn't pay for it, plus copying 2TB of data from home at around 40Mbit/s isn't great. Ideally something that pulls from google directly without involving my home computer would be best.

tiahura 3y ago
Why don’t you give your friend an 8tb to keep at his house and rsync?
toomuchtodo 3y ago
Google Takeout will export to Dropbox, ad hoc or on a cadence (into the /Apps/Google Download Your Data/ path). Backblaze B2 is ~$6/month per TB, so depending on your storage requirements, at some point it will be more cost effective to have a pair of Synology NAS devices; one local, one as a backup offsite, with backups shipped. These same NAS devices can backup directly to a variety of targets [1]. [1] https://kb.synology.com/en-uk/DSM/help/HyperBackup/data_backup_destination?version=7 https://kb.synology.com/en-uk/DSM/help/HyperBackup/data_back... (no affiliation with any above entity)
noveltyaccount 3y ago
Maybe an rclone script that runs from AWS. Package it in a Docker image and run it from a Lambda function for pennies per invocation. Schedule it to run nightly. https://rclone.org/s3/ https://rclone.org/s3/ https://rclone.org/drive/ https://rclone.org/drive/ https://docs.aws.amazon.com/lambda/latest/dg/images-create.html https://docs.aws.amazon.com/lambda/latest/dg/images-create.h... https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-run-lambda-schedule.html https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-... My script, though I run locally rclone -v copy /source/location s3:backup.bucket.name/ --transfers 1 --copy-links --filter-from /config/syncfilter.txt --max-delete 20 --stats 5m --stats-log-level NOTICE --update --use-server-modtime --fast-list My Dockerfile includes RUN curl https://rclone.org/install.sh | bash And I've configured the S3 remote to use Glacier [s3] type = s3 provider = AWS ... storage_class = GLACIER
- bloopernova 3y ago
  Interesting! Thank you, I think I will give this a try soon :)

tiahura 3y ago

Why don’t you give your friend an 8tb to keep at his house and rsync?

toomuchtodo 3y ago

Google Takeout will export to Dropbox, ad hoc or on a cadence (into the /Apps/Google Download Your Data/ path). Backblaze B2 is ~$6/month per TB, so depending on your storage requirements, at some point it will be more cost effective to have a pair of Synology NAS devices; one local, one as a backup offsite, with backups shipped. These same NAS devices can backup directly to a variety of targets [1]. [1] https://kb.synology.com/en-uk/DSM/help/HyperBackup/data_backup_destination?version=7 https://kb.synology.com/en-uk/DSM/help/HyperBackup/data_back... (no affiliation with any above entity)

noveltyaccount 3y ago

Maybe an rclone script that runs from AWS. Package it in a Docker image and run it from a Lambda function for pennies per invocation. Schedule it to run nightly. https://rclone.org/s3/ https://rclone.org/s3/ https://rclone.org/drive/ https://rclone.org/drive/ https://docs.aws.amazon.com/lambda/latest/dg/images-create.html https://docs.aws.amazon.com/lambda/latest/dg/images-create.h... https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-run-lambda-schedule.html https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-... My script, though I run locally rclone -v copy /source/location s3:backup.bucket.name/ --transfers 1 --copy-links --filter-from /config/syncfilter.txt --max-delete 20 --stats 5m --stats-log-level NOTICE --update --use-server-modtime --fast-list My Dockerfile includes RUN curl https://rclone.org/install.sh | bash And I've configured the S3 remote to use Glacier [s3] type = s3 provider = AWS ... storage_class = GLACIER

bloopernova 3y ago
Interesting! Thank you, I think I will give this a try soon :)