Most of the time is spent in decompression - the source dataset used to have files in .bz2, which is the main contributor to total time. The dataset itself is

Most of the time is spent in decompression - the source dataset used to have files in .bz2, which is the main contributor to total time. The dataset itself is just around 10 billion records.