4 ms·
bgzf has a clear advantage when it comes to sorted BED/VCF/GTF formats, especially if one does index these. But frankly I have no idea if it may improve IO tim
by elmolino89 4y ago
bgzf has a clear advantage when it comes to sorted BED/VCF/GTF formats, especially if one does index these.
But frankly I have no idea if it may improve IO times for the fastq files when read by say bwa or another mapper. Do you have any experience with that?
I have seen some mapping times improvement using fastqs with clustered reads (by clumpify).
- jakobnissen 4y agoYes, bgzf can be much faster in practice. Both because the underlying gzip implementation can be simplified (see e.g. libdeflate), and because it can be more effectively parallelised. It doesn't matter if it's IO-bound of course, but compression rarely is.