3 ms·
In addition to logging, you can send out a statsd[0] message, graph it, and use something like Skyline[1] for alerting based on trend issues. You can also use l
by falcolas 12y ago
In addition to logging, you can send out a statsd[0] message, graph it, and use something like Skyline[1] for alerting based on trend issues. You can also use logstash to generate metrics on logs when sending them up to Elasticsearch.
[0] https://github.com/etsy/statsd https://github.com/etsy/statsd
[1] https://github.com/etsy/skyline https://github.com/etsy/skyline
- 616c 12y agoExcellent sample projects, especially Skyline. This seems the closest thing to what I had envisioned sofar. Very cool stuff. Do you use it?
- falcolas 12y agoSkyline was a bit too much overhead, but we took the concept and adapted it to our needs. When I say too much overhead, I'm referring to the carbon proxy and redis requirements. We found that just using the json output from graphite was sufficient to feed a trend monitoring system. The output is pretty sensitive, moreso than Icinga2 (Nagios) expects, so we had to turn down a few of the "is this really down" re-checks, since it would silence legitimate trend alerts.