3 ms·

Also, in many cases in the physical sciences, the data sets (both from experiments and simulations) may simply be too big for long term storage, let alone shari

Also, in many cases in the physical sciences, the data sets (both from experiments and simulations) may simply be too big for long term storage, let alone sharing. CERN is pushing the envelope at around 1 TB new shared data per day, but projects run by groups as small as five people can easily generate tens of terabytes in a day. E.g. with turbulence simulations or tomographic PIV or even just multiple high-speed cameras.

s_q_b 10y ago
Conservatively, it's about $7.00 per terabyte to store and retrieve data on Amazon Glacier per month. Working with petabyte size streams and storage is a pain, but it can be done. https://aws.amazon.com/glacier/pricing/ https://aws.amazon.com/glacier/pricing/