> Also note that this approach generalizes to other text-based formats. If you have 10 gigabyte of CSV, you can use Miller for processing. For binary formats, y

> Also note that this approach generalizes to other text-based formats. If you have 10 gigabyte of CSV, you can use Miller for processing. For binary formats, you could use fq if you can find a workable record separator. You can also generalize it without learning a new minilanguage by using https://github.com/tyleradams/json-toolkit https://github.com/tyleradams/json-toolkit which converts csv/binary/whatever to/from json