4 ms·
First, ask if you really need "massive" scale. Is this an idea, or a well-defined product? I'd imagine if you knew what you were building, you wouldn't be here
by Xorlev 12y ago
First, ask if you really need "massive" scale. Is this an idea, or a well-defined product? I'd imagine if you knew what you were building, you wouldn't be here asking.
So "massive" -- why not prototype on Postgres, and then migrate when you actually have projections on size.
Different orders of magnitude change the technology you work with. Additionally, the latency with which you need to access the metrics (real time, report based).
Cassandra is a pretty solid choice, Influx is really new to the game but is promising.
Druid is trusted by a lot of people, Metamarkets (the author) among them, but may or may not be what you need.
I'd spend some time talking to the people in #druid-dev on Freenode, they're friendly and can help guide you.
- j_s 12y agoSee also this talk by two Metamarkets devs: https://www.youtube.com/watch?v=Hpd3f_MLdXo https://www.youtube.com/watch?v=Hpd3f_MLdXo If accuracy doesn't have to be 100%, a number of options open up.