3 ms·
I've seen two approaches. (We have a lot of customers who deal with this exact problem.) 1.) Down-sample data to aggregates. Keep the aggregated but drop the s
by hodgesrm 6y ago
I've seen two approaches. (We have a lot of customers who deal with this exact problem.)
1.) Down-sample data to aggregates. Keep the aggregated but drop the source data after a certain period of time. You can see historical trends down to the sampling interval but cannot drill down to individual observations.
2.) Use tiered storage. Keep recent data on NVMe SSD and migrate to high density HDD or object storage over time. This allows you to keep more data. Not all DBMS support this out of the box.