Decompression is your friend. Usually CSV compresses really well. Multiple cores decompressing LZ4 compressed data can achieve crazy bandwidth. More than 5 GB/

Decompression is your friend. Usually CSV compresses really well. Multiple cores decompressing LZ4 compressed data can achieve crazy bandwidth. More than 5 GB/s per core.