Many of the VPS providers have a backup option. My personal preference is to have a VM at a few different VPS providers and a cron job that uses lftp to do a r

Many of the VPS providers have a backup option. My personal preference is to have a VM at a few different VPS providers and a cron job that uses lftp to do a rsync-like replication between VPS providers using SFTP. The advantage of lftp over rsync is that I can sync between accounts that are chroot sftp-only with nearly identical capabilities of rsync. The lftp client can also break up one file into multiple TCP streams. In the event a provider terminates my account I could not care less. The files will be at multiple providers and HAProxy will automatically remove them when the content validation health checks fail.