4 ms·
I'd also be curious about how rclone's parallelization compares to gcloud storage's in practice: > Second, it utilizes a new parallelization strategy that trea
by neuronexmachina 4y ago
I'd also be curious about how rclone's parallelization compares to gcloud storage's in practice:
> Second, it utilizes a new parallelization strategy that treats task management as a graph problem, which allows more work to be done in parallel with far less overhead.
> ... In gcloud storage, all operations happen in parallel. As an example, parallel composite uploads are enabled automatically based on bucket configuration. This is a vast improvement compared to gsutil, which requires the -m (parallel operations) flag to improve the performance for uploads and downloads.