2 ms·
One file format I would also recommend, although definitely neither a trend or a rising star, would be HDF5[1], which has done a stellar job for me. It also a t
by jszymborski 11y ago
One file format I would also recommend, although definitely neither a trend or a rising star, would be HDF5[1], which has done a stellar job for me. It also a ton of wrappers, and has been widely used for ages (it's been around in some form or another since 1987 and has been adopted by NASA to store their Earth Observing System data).
[1] https://en.wikipedia.org/wiki/Hierarchical_Data_Format https://en.wikipedia.org/wiki/Hierarchical_Data_Format
- amk_ 11y agoHDF5 is like a mini, portable filesystem. Pretty neat.
- ap22213 11y agoHDF5 is great, but has anyone developed a native Java version? The official version has a Java binding with a nonintuitive interface. And, it requires a lot of prerequisite installations which makes it a bit difficult to deploy. But, I may be completely missing the best practices though.
- jszymborski 11y agoJHDF5[1] seems to be a high-level abstraction that has a nice API from what I can tell. Can't speak to deployment or prereqs, but they seem to have a JAR[2] you can just throw in. [1] https://wiki-bsse.ethz.ch/display/JHDF5/JHDF5+%28HDF5+for+Java%29 https://wiki-bsse.ethz.ch/display/JHDF5/JHDF5+%28HDF5+for+Ja... [2] http://www.hdfgroup.org/products/java/hdf-object/##DOWNLOAD http://www.hdfgroup.org/products/java/hdf-object/##DOWNLOAD
- data_scientist 11y agoHow do you handle strings on hdf5, on an efficient and portable way? I didnt find any convincing answers.