4 ms·
We often have to sync hundreds of thousands of files to S3 and we use this which often hits 300 files a second on a 1Gbps link: https://github.com/mishudark/s3
by tebbers 4y ago
We often have to sync hundreds of thousands of files to S3 and we use this which often hits 300 files a second on a 1Gbps link:
https://github.com/mishudark/s3-parallel-put https://github.com/mishudark/s3-parallel-put