Thanks, I don't remember trying tarsnap. I use $OTHERBIGVENDOR and its been sticky, because I have ~60T of large files (miniDV .mpg captures/4k video/etc) mixed

Thanks, I don't remember trying tarsnap. I use $OTHERBIGVENDOR and its been sticky, because I have ~60T of large files (miniDV .mpg captures/4k video/etc) mixed with an insane number of .5k files from git repos/etc. That combination has broken just about every modern cloud backup application I've tried to use over the ~10 years that meets a short list of minimal features I require (locally stored encryption keys for one). It actually breaks $OTHERBIGVENDOR in its default configuration as well, but I've collected a pile of tweaks/etc that keep it functional although I've managed at one point to cause my account to go into a reindexing mode on the servers that didn't complete for months too. So, maybe at some point. I've got some experience in the space :) and I've considered writing my own when I eventually give up on $OTHERBIGVENDOR. So many of them are written in "modern" languages and the clients are outrageously slow, or get exponentially slower as the data set grows. I've looked at tarsnap in passing in the past, but haven't gotten around to trying it because from their description of what appears to be a traditional referenced counted global dedupe. I suspected it of having problems when the hash map need to track 50T+ unique hashes from all those video files across backups. PS: That doesn't mean there aren't good tools, my local backups are via rsnapshot to an offline USB+RAID I plug in once in a while.