3 ms·
The CoreUtils sort is amazingly efficient, it can sort files nearly as big as your hard drive without matching memory requirements. With all these node.js / Go
by alixaxel 11y ago
The CoreUtils sort is amazingly efficient, it can sort files nearly as big as your hard drive without matching memory requirements.
With all these node.js / Go / Rust CoreUtils implementations I'm still hoping for one of them to actually match the efficiency of the original implementation.
- yincrash 11y agoI wrote the initial sort about a year ago (w/o looking at GNU version's source). I just looked at the current version, and confirmed uutil's sort does not do any external sorting, meaning the entire input is stored in memory. Maybe someone can confirm that GNU's sort uses temporary file storage to do something like an external merge sort to reduce memory usage? edit: confirmed. http://stackoverflow.com/questions/930044/how-could-the-unix-sort-command-sort-a-very-large-file http://stackoverflow.com/questions/930044/how-could-the-unix...