4 ms·
I wonder how long it would take to write out 64Gb of non-compressed 0s . Disclaimer: I work at Continuum and will ask Francesc the same question.
by paddy_m 14y ago
I wonder how long it would take to write out 64Gb of non-compressed 0s .
Disclaimer: I work at Continuum and will ask Francesc the same question.
- freyrs3 14y agommap'ing /dev/zero is the fastest way I know.
- pjscott 14y agoI'm delighted that mmaping /dev/zero is even allowed, though in retrospect I suppose this shouldn't be surprising.
- faltet 14y agoNo doubt that much longer :) But the important points to take away are: 1) You can store more compressed data by using the same storage capacities. 2) If data can be compressed, the I/O effort will be less 3) If the compressor is fast enough, you may end saving I/O time As for 2), Blosc can be pretty fast as can be seen in: http://blosc.pytables.org/trac/wiki/SyntheticBenchmarks http://blosc.pytables.org/trac/wiki/SyntheticBenchmarks so, in general, will speed up I/O for compressible data (even if that data is in-memory).