3 ms·
The reason I run in the cloud to be close to the object storage and average bandwidth between machines. I run big batch jobs and setting up a full cluster file
by dekhn 7y ago
The reason I run in the cloud to be close to the object storage and average bandwidth between machines.
I run big batch jobs and setting up a full cluster filesystem and fast network is non-trivial.
Recently, using S3 with VMs that have 25Gbit network, I can easily make 'aws s3 cp' (after tuning) generate 10+Gbit of traffic reliably.