67 ms·
We have a requirement of saving 100million data points every 5 mins. What options should we explore for real time system for last 15 days of data and archival s
by Throaway786 9y ago
We have a requirement of saving 100million data points every 5 mins. What options should we explore for real time system for last 15 days of data and archival system for last 3 years of data?
- mfreed 9y agoWe've had users at that scale at least on the real-time side (e.g., 100M/5min, 500B rows), although requires some care. Might be easiest to discuss more on Slack (https://slack-login.timescale.com/ https://slack-login.timescale.com/) or email (mike at timescale) if you're interested.
- subleq 9y agoI don't have any experience with this type of thing, so that sounds like an incredibly large amount of data. What are you doing that requires it? What type of useful queries are you even able to perform over 432 billion records?