3 ms·
I need this, just finished 300GB of CSV extracts, and manipulating, data integrity checks, and so on take longer than they should.
by theropost 1y ago
I need this, just finished 300GB of CSV extracts, and manipulating, data integrity checks, and so on take longer than they should.
- constantcrying 1y agoWhy wouldn't you use a data format meant to store floating point numbers? HDF5 gives you a great way to store such data.
- theropost 1y agoSounds interesting, I'll give it a look. I'm unfortunately limited to CSV, XML, or XLS from the source system, then am transforming it and loading it into another DB.