4 ms·
For a long time I have just piped tar over ssh. For lots of small files, it's faster than an rsync to an empty directory. It can also sync anything that the t
by aidenn0 6y ago
For a long time I have just piped tar over ssh. For lots of small files, it's faster than an rsync to an empty directory. It can also sync anything that the tar on both sides can handle. I wrote a script for doing this for my coworkers who identify with https://xkcd.com/1168/ https://xkcd.com/1168/
- jerf 6y agoOne thing I like about this solution is fine-grained control over the compression. I've used xz on a slow connection to the other side of the world, I've used no compression on super fast connections. You get whatever you want.
- aidenn0 6y agoIndeed! Unless it's a wired LAN connection, zstd will not make things slower on lower settings, and can make it faster
- sroussey 6y agoI pipe tar over nc if encryption does not matter.
- aidenn0 6y agoI use ssh because it's easier to use than nc, and there are very few hosts with encryption performance slower than network performance. On a 10g line it might matter, but gigabit or usually doesn't.