2 ms·
> 727,080 snapshots in time for each variable like temperature Maybe we should be recording and transmitting the parameters for a function or set of functions
by user3939382 3y ago
> 727,080 snapshots in time for each variable like temperature
Maybe we should be recording and transmitting the parameters for a function or set of functions that describes these temperature etc changes rather than a set of points to drastically reduce the size of these data sets.
- PolarizedPoutin 3y agoAre you suggesting compressing the data using like Fourier series or wavelets? I know some of the variables have sharp gradients, especially variables like precipitation, which probably wouldn't compress super well. And some applications of the ERA5 dataset, e.g. closing heat or moisture budgets by accounting for every bit of it, cannot be done if the data has been compressed since you lose some data. Curious if this is what you had in mind or something else.