4 ms·

I'm interested in what the pricing will be like at various scales, on Twitter the CEO (Paul Dix) indicated $400 month will be the basic offering for limited cor

I'm interested in what the pricing will be like at various scales, on Twitter the CEO (Paul Dix) indicated $400 month will be the basic offering for limited cores. I guess time will tell, but a bigger deal than the money to me is will the clustering actually work well? Clustered databases is an extremely difficult problem. Seen it get better in the years in things like MsSQL, but even with that sort of resources it took a long time (years) for the newer availability model to become stable. At Stack Overflow we are still using OpenTSBD behind Bosun. But HBase sucks to manage if you don't have any other reason to be using the technology. So I see a lot of users interested in using InfluxDB as the backend (and some do, Bosun can talk to it) because it is easier to get started. But if you know you will have to scale up eventually, all the options right now are not appealing in TSDB land :-/ So if some $$ really does get a good TSDB that scales and reasonable to manage then great, but I'm skeptical.

pauldix 11y ago
We're committed to making the clustering a world class product. You're right, it'll take time. However, we'll get there. We'll put the same focused effort and testing into it over the coming months and years that we put into the TSM storage engine, which is working remarkably well at significant loads. In the meantime, the stuff we have going into the open source is going to make the standalone server (and thus anyone using open source options for HA or clustering) even more performant, stable, and scalable.
- KyleBrandt 11y ago
  While skeptical, I am also very hopeful! I think at Stack we will want to set up a cluster and see how it works for us once it becomes available. We use a relay (bosun.org/cmd/tsdbrelay) to send data to OpenTSDB and it also "tees" it to Bosun for indexing and another OpenTSDB cluster. So sending all of our data to an Influx cluster will be as simple as adding that as another endpoint to our relay since you have an OpenTSDB endpoint.
- jrv 11y ago
  ...anyone using open source options for HA or clustering... What open-source option for clustering would this be if the main InfluxDB open-source version won't have clustering anymore? A fork or something built on top of multiple standalone servers somehow?
  - KyleBrandt 11y ago
    I think maybe the other HA options, such as using a relay or sharding as stated in https://influxdata.com/high-availability/ https://influxdata.com/high-availability/
    - jrv 11y ago
      That sounds plausible, thanks!
kev009 11y ago
The suck of running HBase is that it is several large components, but it actually works. A product that doesn't work and over promises like InfluxDB sucks infinitely more. Use GCE's BigTable if you want to shed the support of HBase.
meirelles 11y ago
Check out KairosDB. Run on top of Cassandra. It's pretty stable, easy to maintain and update. Comes with some limitations, but still worthy to check out if fits your usage. The server itself is stateless which is great for HA and scaling.
- bogomipz 11y ago
  I don't believe Kairos has the ability to create any kind of a retention policy - example "after 4 weeks do rollups of the data to hourly resolution, and keep for 6 months total" Can you explain how you handle that with KairosDB? Also it looks like the KairosDB docs haven't been updated in any significant way in a couple of years(other than moving it to github.io) For a project thats been around for a few years this is kind of surprising.
  - meirelles 11y ago
    Unfortunately, KairosDB doesn't do rollups automatically. That sucks, but the performance still works fine for me. Space isn't a issue, Cassandra handles it pretty well. You can set retention policy per data point (TTL) if you need so. If you really need rollups, you can do it manually, saving a query result to a new metric name... I wasted a lot of time looking for a bulletproof time series db. I found nothing, each one of them have their own set of issues.

pauldix 11y ago

We're committed to making the clustering a world class product. You're right, it'll take time. However, we'll get there. We'll put the same focused effort and testing into it over the coming months and years that we put into the TSM storage engine, which is working remarkably well at significant loads. In the meantime, the stuff we have going into the open source is going to make the standalone server (and thus anyone using open source options for HA or clustering) even more performant, stable, and scalable.

KyleBrandt 11y ago
While skeptical, I am also very hopeful! I think at Stack we will want to set up a cluster and see how it works for us once it becomes available. We use a relay (bosun.org/cmd/tsdbrelay) to send data to OpenTSDB and it also "tees" it to Bosun for indexing and another OpenTSDB cluster. So sending all of our data to an Influx cluster will be as simple as adding that as another endpoint to our relay since you have an OpenTSDB endpoint.
jrv 11y ago
...anyone using open source options for HA or clustering... What open-source option for clustering would this be if the main InfluxDB open-source version won't have clustering anymore? A fork or something built on top of multiple standalone servers somehow?
- KyleBrandt 11y ago
  I think maybe the other HA options, such as using a relay or sharding as stated in https://influxdata.com/high-availability/ https://influxdata.com/high-availability/
  - jrv 11y ago
    That sounds plausible, thanks!

kev009 11y ago

The suck of running HBase is that it is several large components, but it actually works. A product that doesn't work and over promises like InfluxDB sucks infinitely more. Use GCE's BigTable if you want to shed the support of HBase.

meirelles 11y ago

Check out KairosDB. Run on top of Cassandra. It's pretty stable, easy to maintain and update. Comes with some limitations, but still worthy to check out if fits your usage. The server itself is stateless which is great for HA and scaling.

bogomipz 11y ago
I don't believe Kairos has the ability to create any kind of a retention policy - example "after 4 weeks do rollups of the data to hourly resolution, and keep for 6 months total" Can you explain how you handle that with KairosDB? Also it looks like the KairosDB docs haven't been updated in any significant way in a couple of years(other than moving it to github.io) For a project thats been around for a few years this is kind of surprising.
- meirelles 11y ago
  Unfortunately, KairosDB doesn't do rollups automatically. That sucks, but the performance still works fine for me. Space isn't a issue, Cassandra handles it pretty well. You can set retention policy per data point (TTL) if you need so. If you really need rollups, you can do it manually, saving a query result to a new metric name... I wasted a lot of time looking for a bulletproof time series db. I found nothing, each one of them have their own set of issues.