4 ms·
I wanted to download a few hundreds of files, but the server was enabling only 4 simultaneous connections. I did a makefile like file1: wget http
by thealistra 9y ago
I wanted to download a few hundreds of files, but the server was enabling only 4 simultaneous connections.
I did a makefile like
file1:
wget http://example.com/file1
file2:
wget http://example.com/file2
file3:
wget http://example.com/file3
And used make -j4 to download all of them, but only 4 parallel tasks at once. It starts another download when one finishes
- toomuchtodo 9y agoCheck out aria2 next time. https://aria2.github.io/ https://aria2.github.io/
- stephenr 9y agoXargs parallel processing or Gnu parallel would probably help a lot here.