4 ms·
Doesn't sort require keeping lines in memory as well? In fact, doesn't sort keep all lines in memory, whereas this awk solution just keeps the unique lines.
by omh 7y ago
Doesn't sort require keeping lines in memory as well?
In fact, doesn't sort keep all lines in memory, whereas this awk solution just keeps the unique lines.
- ot 7y agoNo, most implementations of sort use a bounded memory buffer and an external-memory algorithm, spilling to disk.
- chii 7y agoI don't believe that - how does it spill to disk? TMP directory? You can still sort if you don't have any disk space (until you run out of swap?) from what I recall.
- chasil 7y agoThe man page for sort has parameters to adjust the location of the temporary files. These are only used when the allowed memory buffer is exhausted.
- JdeBP 7y agoYour recollection is either limited in what implementations you have encountered, or faulty. * https://unix.stackexchange.com/a/450900/5132 https://unix.stackexchange.com/a/450900/5132