4 ms·
I'm surprised the CPU would in any way be the bottleneck for transferring data. Is it really faster to parallelize that?
by juujian 3y ago
I'm surprised the CPU would in any way be the bottleneck for transferring data. Is it really faster to parallelize that?
- deleted 3y ago[deleted]
- Ultimatt 3y agoIt's more GNU Parallel has host groups in a config so you can send files for a job to the right one where its going to execute and bring things back. Essentially it can turn a local xargs type job into any kind of remote task execution including dealing with files locally needing to be remote.