2 ms·
Before reaching for spark, etc: Sort is good for aggregations that fit on disk (TBs these days, I guess) Perl does well too if the output fits in a hashtable
by hedora 8y ago
Before reaching for spark, etc:
Sort is good for aggregations that fit on disk (TBs these days, I guess)
Perl does well too if the output fits in a hashtable in DRAM, so 10’s (or maybe 100’s?) of GBs