5 ms·

I was able to get in running against an existing statsd installation trivially, and explore it to my heart's content on my existing metrics. And I can look at t

I was able to get in running against an existing statsd installation trivially, and explore it to my heart's content on my existing metrics. And I can look at the source - what more do you want? That was the easiest 3rd-party dashboard setup I've ever experienced.

olidb2 14y ago
Thanks katabatic - reducing friction was exactly what we were going for.
otterley 14y ago
If your needs are trivial, then it's probably adequate. Not everyone's needs are, though. I'm trying to evaluate it in the context of needing an enterprise-grade dashboard solution, with tens of thousands of metrics across thousands of hosts, and robust filtering/aggregation capability. To my knowledge nobody has really solved this problem yet in a satisfactory way, outside some closed-source solutions at big internet companies.
- olidb2 14y ago
  otterley - for that, you can take a look at http://datadoghq.com http://datadoghq.com. We do all of the above. Our service isn't free beyond 5 hosts, but is quite a bit cheaper than rolling and running your own or flying blind and facing the consquences. It's a hard problem, and we're on a mission to solve it for companies that don't start with goo* or end in *ook.
  - otterley 14y ago
    I looked at Datadog, but they still suffer from the same malady everyone else does: inspired by Cacti and Graphite, they use a flat namespace for metric names (e.g. interfaces.eth0.pkts) and host is the only supported dimension you can query against. Unfortunately, none of the monitoring and analytics startups I'm aware of have support for arbitrary dimensions you can query or aggregate against (host, interface, disk, datacenter, etc.). Without some understanding of the dimensions of the data, it is very difficult to compose dashboards or aggregation rules that have arbitrary filters or can update automatically when new components are added. I really ought to elaborate in a blog post someday :)
    - olidb2 14y ago
      otterley - Don't walk away yet... we do support arbitrary dimensions! You can attach any arbitrary set of tags to metrics or events - on a per-datapoint basis, and slice / dice / alert based on those tags. Datadog will automatically tag your points by chef role or AWS availability-zone, for example, and you can add any other tag you want. Tags also don't have to be tied to a host and can also relate to a specific volume, mysql index, etc... (Note to HN, this is a feature of datadoghq - pup will gladly collect and filter on tags, but won't aggregate them, yet)
      - otterley 14y ago
        But tags aren't dimensions. Tags are merely a list of dimensionless values and completely lack context that are essential for dashboard construction and value aggregation. Suppose I apply the tags "ord", "foo.example.com" and "bar.example.org" to a metric. How does the dashboard builder or the aggregator know what they are? They're values without the fields.
        olidb2 14y ago
        Got it. Tags can be of the name:value kind. for ex: role:db or availability-zone:us-east-a1 or foo:bar And you can then ask for "my.metric" summed over "availability-zone:us-east-1a" grouped by "role". Here's a screenshot to show what it looks like https://skitch.com/oliveur/emywc/sobotka-datadog https://skitch.com/oliveur/emywc/sobotka-datadog You obviously have a lot of experience with monitoring tools - I'd love to connect. I'm @oliveur on the twitters.

olidb2 14y ago

Thanks katabatic - reducing friction was exactly what we were going for.

otterley 14y ago

If your needs are trivial, then it's probably adequate. Not everyone's needs are, though. I'm trying to evaluate it in the context of needing an enterprise-grade dashboard solution, with tens of thousands of metrics across thousands of hosts, and robust filtering/aggregation capability. To my knowledge nobody has really solved this problem yet in a satisfactory way, outside some closed-source solutions at big internet companies.

olidb2 14y ago
otterley - for that, you can take a look at http://datadoghq.com http://datadoghq.com. We do all of the above. Our service isn't free beyond 5 hosts, but is quite a bit cheaper than rolling and running your own or flying blind and facing the consquences. It's a hard problem, and we're on a mission to solve it for companies that don't start with goo* or end in *ook.
- otterley 14y ago
  I looked at Datadog, but they still suffer from the same malady everyone else does: inspired by Cacti and Graphite, they use a flat namespace for metric names (e.g. interfaces.eth0.pkts) and host is the only supported dimension you can query against. Unfortunately, none of the monitoring and analytics startups I'm aware of have support for arbitrary dimensions you can query or aggregate against (host, interface, disk, datacenter, etc.). Without some understanding of the dimensions of the data, it is very difficult to compose dashboards or aggregation rules that have arbitrary filters or can update automatically when new components are added. I really ought to elaborate in a blog post someday :)
  - olidb2 14y ago
    otterley - Don't walk away yet... we do support arbitrary dimensions! You can attach any arbitrary set of tags to metrics or events - on a per-datapoint basis, and slice / dice / alert based on those tags. Datadog will automatically tag your points by chef role or AWS availability-zone, for example, and you can add any other tag you want. Tags also don't have to be tied to a host and can also relate to a specific volume, mysql index, etc... (Note to HN, this is a feature of datadoghq - pup will gladly collect and filter on tags, but won't aggregate them, yet)
    - otterley 14y ago
      But tags aren't dimensions. Tags are merely a list of dimensionless values and completely lack context that are essential for dashboard construction and value aggregation. Suppose I apply the tags "ord", "foo.example.com" and "bar.example.org" to a metric. How does the dashboard builder or the aggregator know what they are? They're values without the fields.
      - olidb2 14y ago
        Got it. Tags can be of the name:value kind. for ex: role:db or availability-zone:us-east-a1 or foo:bar And you can then ask for "my.metric" summed over "availability-zone:us-east-1a" grouped by "role". Here's a screenshot to show what it looks like https://skitch.com/oliveur/emywc/sobotka-datadog https://skitch.com/oliveur/emywc/sobotka-datadog You obviously have a lot of experience with monitoring tools - I'd love to connect. I'm @oliveur on the twitters.