5 ms·
How does this compare to the existing s3cmd [1] tool? One issue I've had with s3cmd is it tends to use a lot of memory when syncing two large buckets. I'd love
by mfonda 13y ago
How does this compare to the existing s3cmd [1] tool? One issue I've had with s3cmd is it tends to use a lot of memory when syncing two large buckets. I'd love to see a tool that was faster / more memory efficient than s3cmd. Would be awesome to see some benchmarks and feature comparison in the README!
[1] http://s3tools.org/s3cmd http://s3tools.org/s3cmd
- rsync 13y agoAgreed. We support s3cmd: ssh user@rsync.net s3cmd get s3://rsynctest/mscdex.exe ... and have for some time ... but we'd be happy to have some diversity there. One thing that sticks out immediately, of course, is that s3cmd is written in python and s3sync is a ruby gem. This makes things difficult since we insist on having no interpreters in our customer chroot...[1] [1] We "freeze" things like s3cmd and rdiff-backup into binary executables so they don't require python in the environment
- clarete 13y agoSo, basically, the main difference is the language they're implemented in. I started working on s3sync cause I found its code easier to read and I really needed to practice my ruby skills. Although s3cmd is older and has more features, s3sync was designed to grow stable and well tested. I'm definitely planning to write benchmarks to s3sync and improve its performance as much as I can.
- bender80 13y agoThank you. Does this support IAM Roles?
- eterps 13y agoThe speed of https://github.com/cobbzilla/s3s3mirror https://github.com/cobbzilla/s3s3mirror is quite impressive, I suggest you give it a try.