3 ms·
Somewhat related, I just came across s5cmd[1] which is mainly focused on performance and fast upload/download and sync of s3 buckets. > 32x faster than s3cmd a
by nodesocket 1y ago
Somewhat related, I just came across s5cmd[1] which is mainly focused on performance and fast upload/download and sync of s3 buckets.
> 32x faster than s3cmd and 12x faster than aws-cli. For downloads, s5cmd can saturate a 40Gbps link (~4.3 GB/s), whereas s3cmd and aws-cli can only reach 85 MB/s and 375 MB/s respectively.
[1] https://github.com/peak/s5cmd https://github.com/peak/s5cmd
- rsync 1y agos5cmd is built into the rsync.net platform. See: https://news.ycombinator.com/item?id=44248372 https://news.ycombinator.com/item?id=44248372
- uncircle 1y agoI prefer s5cmd as well because it has a better CLI interface than s3cmd, especially if you need to talk with non-AWS S3-compatible servers. It does few things and does them well, whereas s3cmd is a tool with a billion options, configuration files, badly documented env variables, and its default mode of operation assumes you are talking with AWS.
- bradknowles 1y agoFor the time I worked at AWS, pretty much everyone inside the company used s5cmd for its speed. I think that speaks pretty highly of it.