3 ms·
I often copy (not synchronize) remote files using rsync instead of scp because rsync will batch the small files, and scp does not. Or zip up (or tar) the small
by ars 6y ago
I often copy (not synchronize) remote files using rsync instead of scp because rsync will batch the small files, and scp does not.
Or zip up (or tar) the small files, copy over the large archive, then unzip.
They are having the same issue here: A lot of small files each transferred one at a time, instead of in a streaming batch.
- awiesenhofer 6y agoYou are getting downvoted because tfa is about the s3 protocol. All of these commands unfortunately wont help you with s3. If you want to manipulate that from the command line you are basically stuck with aws cli, s3/s4cmd or scripting it yourself using a library.
- ars 6y agoI wasn't giving them advice, I was just talking about a similar problem in another context.