3 ms·
Just a few weeks ago I was working with an 11TB dataset which I processed with just unix command line tools told on a single Linux VM. You can get a lot of mil
by zaphar 8y ago
Just a few weeks ago I was working with an 11TB dataset which I processed with just unix command line tools told on a single Linux VM.
You can get a lot of milage out of parallel xargs and other of the shelf tools.
- srean 8y agoIndeed! Gnu prallel, xargs, make -j, netcat, mawk/gawk (with C extensions if needed), jq, coreutils, textutils can get insane amount of stuff done.