3 ms·

You don't need to store everything uncompressed. Just gz everything and you gain several orders of magnitude.