I use rclone on vm instances to sync files across gdrive, google photos , one drive , s3 and gcp object storage . Running migrations on the server side is fast

I use rclone on vm instances to sync files across gdrive, google photos , one drive , s3 and gcp object storage . Running migrations on the server side is faster and more reliable. I can monitor transforms and transfers in tmux and then run quality checks when it’s complete And having a vm lets me filter and transform the data during the migration. Eg pruning files , pruning git repos, compressing images . There’s a framework waiting to be made that’s like grub but for personal data warehouse grooming like this