6 ms·

Grafana 2.0 Released

157 points by eloycoto 12y ago

ClawsX 12y ago
AAwesome! Upgrading this week!
emilsedgh 12y ago
Just started using Grafana+Influxdb this week. Could not be happier :) Congrats.
- torkelo 12y ago
  Thanks!
deleted 12y ago
[deleted]
sikhnerd 12y ago
This looks great! FYI, the demo site link is broken (missing a : )
- torkelo 12y ago
  Thanks for spotting that, fix in publishing now!
andyl 12y ago
Oh - this is Marvelous. Congrats Torkel!! We plan to put your new multi-tenant features to work! Now waiting for InfluxDB 0.9 - then we're off to the races.
- Mahn 12y ago
  There's a fork for InfluxDB 0.9: https://github.com/influxdb/grafana/tree/influx-0.9rc4 https://github.com/influxdb/grafana/tree/influx-0.9rc4 No idea how well it works, haven't tried it yet, but I would imagine it's still incomplete.
deleted 12y ago
[deleted]
- torkelo 12y ago
  The delay could be because you are far from New York where the graphite server is. But I am as well (in Stockholm), the delay is between 200ms-600ms for me. then maybe 100ms for the canvas rendering. Also the delay is higher than usual now because the demo site is busy now with the release announcement and lots of traffic from hacker news and twitter. The rendering is very fast, switching dashboards can be under between 500ms-2 seconds. Just zooming on on the graph and you have a fast metric store is usually almost instant.
copsarebastards 12y ago
What is Grafana? I'm having trouble getting a clear explanation of what it is.
- torkelo 12y ago
  Its a dashboard and graph composer for realtime and and historical metric analytic (mostly via rich graphs). Usually used for monitoring or application metrics analytic but can be used in many other scenarios as well.
- Mahn 12y ago
  Picture phpMyAdmin, but for metrics and time series data. You point it to a time series database (such as Graphite or InfluxDB) and the app draws the charts for you with whatever settings you need, and puts them together in pretty dashboards for easy consumption.
- Florin_Andrei 12y ago
  Graphite + Grafana are like Cacti or Munin, but orders of magnitude smarter and more powerful. Grafana is the visualization part of the combo. Graphite is the data storage and query engine.
seanwilson 12y ago
From the homepage: > An open source, feature rich metrics dashboard and graph editor for Graphite, InfluxDB & OpenTSDB.
- bbrazil 12y ago
  Looks like Prometheus support is in the works too: https://github.com/grafana/grafana-plugins/pull/13 https://github.com/grafana/grafana-plugins/pull/13 That repo also has Atlas, Zabbix and KairosDB plugins.
setheron 12y ago
I remember wanting to use graphite for a pet project and stumbled across early release Grafana. I'm amazed at all the nagging items I had (even though I still used it) have been resolved. The CORS, shipping with its own backend, not needing elastic search (such a pain!) and sharing graphs are stellar. Truly amazing.
Guillaume86 12y ago
How does that compare to the ELK (ElasticSearch/LogStash/Kibana) stack? (Is it even right to compare?) I'm currently evaluating ElasticSearch + Kibana to handle metrics/errors/application logs in our web app, it's impressive but Kibana is lacking a lot of features to be complete IMO. Good point for ELK in my case is that it runs on windows which is not the case of InfluxDB it seems (running on windows is a requirement in my company unfortunately).
- phildougherty 12y ago
  It's a similar web interface (Grafana is based on Kibana), but for different things. ELK is best for deciphering large amounts of data from logs IMHO. Yes logstash has tons of plugins for third party monitoring systems, but generally speaking you're going to dump your web server access/error logs and syslogs into your ELK setup. Grafana makes graphite/influxdb more useful and is by far and away the best option available. Usually you're going to be tracking things like cpu/memory/diskio/network traffic, but also anything from StatsD in your Grafana setup. Combining the two systems into one could be neat, but they work great on their own and have their own benefits.
  - eloycoto 12y ago
    I'm using Grafana + Influxdb + statsd and I'm quite happy: - In our django/python apps I'm using statsd client - For server monitoring I'm using diamond - For dashboards I'm using grafana. I have in a few clicks all company information. I used ELK service, but only for logs but queries were difficult for me. But, ELK is great for PFsense routers[http://elijahpaul.co.uk/monitoring-pfsense-2-1-logs-using-elk-logstash-kibana-elasticsearch/ http://elijahpaul.co.uk/monitoring-pfsense-2-1-logs-using-el...], or you can use http://packetbeat.com/ http://packetbeat.com/ if you want to monitor all your servers. Last week I spoke in a local community about my stack. Here you have my slides + examples: http://acalustra.com/statsd-talk-at-python-vigo-meetup.html http://acalustra.com/statsd-talk-at-python-vigo-meetup.html Regards
  - Guillaume86 12y ago
    Thanks for the response. I should probably give a shot to Kibana 3.x because I'm on 4.x and I suspect it's still pretty new and lacking in features because of it. I could already track system metrics on windows with WMI (well I know CPU and memory is possible at least) and send them to ES but I will need to hand code it to avoid LogStash (too big for this simple job in my case).
phildougherty 12y ago
I think the most useful feature in Grafana for me has been Templating. It's really powerful and works well in an AutoScaling environment where things come and go. with graphite-web it would be a fight to keep the graphs collecting the right data points, or updating them if your hostname scheme changes, etc.
- Rapzid 12y ago
  I use it heavily as well to create generic dashboards for looking at clusters/sites, etc. Its a shame kibana4 nerf'd templating :|
- Florin_Andrei 12y ago
  In an autoscaling environment, you just need to keep your metric paths consistent. Then all you need is wildcard queries. E.g., CPU userspace cycles on all your instances should be like: provider.region.vpc.group.instance-id.os.cpu.user E.g.: aws.us-west-1.prod.web-front.i-4df567a9.os.cpu.user Then wildcard queries will provide you aggregate stats at any level you like. It's really a feature of how Graphite queries work. -------------------- All that being said, I agree that Grafana is pretty awesome.
  - phildougherty 12y ago
    That's true. I guess what I prefer about doing it in Grafana is that the interface for managing complex graphs with overlays of different metrics, and ones using wildcards to match groups of metrics is just way easier.
simonpantzare 12y ago
Very nice, congrats on the release! Had it up and running and our Grafana 1.x dashboards imported in about 15min. I was intrigued reading about the plans for alert support. Any pointers on where to start looking for somebody that may want to help build it? :) Would love to buy a coffee or beer some time in Stockholm.
- torkelo 12y ago
  That is awesome (that the upgrade was that smooth). I am going this meetup at DICE on Thursday, https://sites.google.com/site/stockholmgtug/Home/20150423 https://sites.google.com/site/stockholmgtug/Home/20150423
Rygu 12y ago
> The Graph panel now supports 3 logarithmic scales, log base 10, log base 32, log base 1024. Logarithmic y-axis scales are very useful when rendering many series of different order of magnitude on the same scale (eg. latency, network traffic, and storage) Have been waiting eagerly for logarithmic scale support.
- bbrazil 12y ago
  What's base 32 used for?
  - torkelo 12y ago
    Useful for display series that represent storage space or IO, get get y axis ticks like 1 KB, 32KB, 1MB, 32MB, 1GB http://play.grafana.org/dashboard/db/new-features-in-v20?panelId=2&fullscreen http://play.grafana.org/dashboard/db/new-features-in-v20?pan...
anton_gogolev 12y ago
On a very tangentially related note: we've recently open-sourced our .NET port of StatsD/Graphite and it's available under MIT license at https://bitbucket.org/aeroclub-it/statsify https://bitbucket.org/aeroclub-it/statsify
- torkelo 12y ago
  interesting! I am working on a windows build of grafana 2 right now. Does statsify have a /render and /metrics/find api that is compatible with graphite? If it had grafana could use it.
  - anton_gogolev 12y ago
    It has something similar to "/render"[0], but it's not Graphite-compatible. There's also support for "/find", but it is currently not the part of the public API. Adding Graphite-compatible endpoints should be fairly easy and this can really open up a lot of integration opportunities. [0]: https://bitbucket.org/aeroclub-it/statsify/wiki/Home#markdown-header-retrieving-graphing-and-analyzing-metrics https://bitbucket.org/aeroclub-it/statsify/wiki/Home#markdow...
    - torkelo 12y ago
      Could you move that project to github? I think that project has great potential coupled with Grafana. I will add windows builds to the install and download pages today. Here is a windows build for grafana 2.0.1 https://s3.amazonaws.com/grafanarel/winbuilds/dist/grafana-2.0.1.windows-x64.zip https://s3.amazonaws.com/grafanarel/winbuilds/dist/grafana-2...
BrainInAJar 12y ago
iframe embedded graphs would've helped me out immensely 8 months ago, So happy to see them now
kstenerud 12y ago
One quick note to people writing release notes pages: Often these pages get posted to news aggregators, and the people who click on those links are not as likely to be familiar with your product. A quick 1-2 line elevator pitch at the top would do wonders.
- sean_the_geek 12y ago
  Couldn't' agree more! I am interested but struggling to get exactly what it does..is it like Gephi..who knows???
- kbody 12y ago
  Although, I disagree, there is a note on the sidebar.
distantsounds 12y ago
What's the recommended backend for this? I tried it with InfluxDB but felt that the feature set wasn't really up there, I couldn't get graphs to display the data I wanted. We have a graphite instance elsewhere but it's running into disk space issues - will that be an issue here, too?
- lifeisstillgood 12y ago
  Graph an is a wholly JavaScript "chart display" front end that hacienda onto a grpahite-query-compatible server. This is usually the graphite server that usually is storing rrd data into a carbon database. However there are it seems a wide variety of choices. My view is if any form of column orientated data structure is struggling, try sharding your time series long before you swap technologies.
T-A 12y ago
I wanted to try http://docs.grafana.org/v2.0/installation/windows/ http://docs.grafana.org/v2.0/installation/windows/ but when I click the "build from source" link, I get "Sorry, page not found.". :(
- torkelo 12y ago
  strange works now.
dyb 12y ago
ElasticSearch was one of the data sources to grafana [1.8.1]. I do not see anything that points to "still works" in the docs. Has this changed?

157 points by eloycoto 12y ago

ClawsX 12y ago

AAwesome! Upgrading this week!

emilsedgh 12y ago

Just started using Grafana+Influxdb this week. Could not be happier :) Congrats.

torkelo 12y ago
Thanks!

deleted 12y ago

[deleted]

sikhnerd 12y ago

This looks great! FYI, the demo site link is broken (missing a : )

torkelo 12y ago
Thanks for spotting that, fix in publishing now!

andyl 12y ago

Oh - this is Marvelous. Congrats Torkel!! We plan to put your new multi-tenant features to work! Now waiting for InfluxDB 0.9 - then we're off to the races.

Mahn 12y ago
There's a fork for InfluxDB 0.9: https://github.com/influxdb/grafana/tree/influx-0.9rc4 https://github.com/influxdb/grafana/tree/influx-0.9rc4 No idea how well it works, haven't tried it yet, but I would imagine it's still incomplete.

deleted 12y ago

[deleted]

torkelo 12y ago
The delay could be because you are far from New York where the graphite server is. But I am as well (in Stockholm), the delay is between 200ms-600ms for me. then maybe 100ms for the canvas rendering. Also the delay is higher than usual now because the demo site is busy now with the release announcement and lots of traffic from hacker news and twitter. The rendering is very fast, switching dashboards can be under between 500ms-2 seconds. Just zooming on on the graph and you have a fast metric store is usually almost instant.

copsarebastards 12y ago

What is Grafana? I'm having trouble getting a clear explanation of what it is.

torkelo 12y ago
Its a dashboard and graph composer for realtime and and historical metric analytic (mostly via rich graphs). Usually used for monitoring or application metrics analytic but can be used in many other scenarios as well.
Mahn 12y ago
Picture phpMyAdmin, but for metrics and time series data. You point it to a time series database (such as Graphite or InfluxDB) and the app draws the charts for you with whatever settings you need, and puts them together in pretty dashboards for easy consumption.
Florin_Andrei 12y ago
Graphite + Grafana are like Cacti or Munin, but orders of magnitude smarter and more powerful. Grafana is the visualization part of the combo. Graphite is the data storage and query engine.

seanwilson 12y ago

From the homepage: > An open source, feature rich metrics dashboard and graph editor for Graphite, InfluxDB & OpenTSDB.

bbrazil 12y ago
Looks like Prometheus support is in the works too: https://github.com/grafana/grafana-plugins/pull/13 https://github.com/grafana/grafana-plugins/pull/13 That repo also has Atlas, Zabbix and KairosDB plugins.

setheron 12y ago

I remember wanting to use graphite for a pet project and stumbled across early release Grafana. I'm amazed at all the nagging items I had (even though I still used it) have been resolved. The CORS, shipping with its own backend, not needing elastic search (such a pain!) and sharing graphs are stellar. Truly amazing.

Guillaume86 12y ago

How does that compare to the ELK (ElasticSearch/LogStash/Kibana) stack? (Is it even right to compare?) I'm currently evaluating ElasticSearch + Kibana to handle metrics/errors/application logs in our web app, it's impressive but Kibana is lacking a lot of features to be complete IMO. Good point for ELK in my case is that it runs on windows which is not the case of InfluxDB it seems (running on windows is a requirement in my company unfortunately).

phildougherty 12y ago
It's a similar web interface (Grafana is based on Kibana), but for different things. ELK is best for deciphering large amounts of data from logs IMHO. Yes logstash has tons of plugins for third party monitoring systems, but generally speaking you're going to dump your web server access/error logs and syslogs into your ELK setup. Grafana makes graphite/influxdb more useful and is by far and away the best option available. Usually you're going to be tracking things like cpu/memory/diskio/network traffic, but also anything from StatsD in your Grafana setup. Combining the two systems into one could be neat, but they work great on their own and have their own benefits.
- eloycoto 12y ago
  I'm using Grafana + Influxdb + statsd and I'm quite happy: - In our django/python apps I'm using statsd client - For server monitoring I'm using diamond - For dashboards I'm using grafana. I have in a few clicks all company information. I used ELK service, but only for logs but queries were difficult for me. But, ELK is great for PFsense routers[http://elijahpaul.co.uk/monitoring-pfsense-2-1-logs-using-elk-logstash-kibana-elasticsearch/ http://elijahpaul.co.uk/monitoring-pfsense-2-1-logs-using-el...], or you can use http://packetbeat.com/ http://packetbeat.com/ if you want to monitor all your servers. Last week I spoke in a local community about my stack. Here you have my slides + examples: http://acalustra.com/statsd-talk-at-python-vigo-meetup.html http://acalustra.com/statsd-talk-at-python-vigo-meetup.html Regards
- Guillaume86 12y ago
  Thanks for the response. I should probably give a shot to Kibana 3.x because I'm on 4.x and I suspect it's still pretty new and lacking in features because of it. I could already track system metrics on windows with WMI (well I know CPU and memory is possible at least) and send them to ES but I will need to hand code it to avoid LogStash (too big for this simple job in my case).

phildougherty 12y ago

I think the most useful feature in Grafana for me has been Templating. It's really powerful and works well in an AutoScaling environment where things come and go. with graphite-web it would be a fight to keep the graphs collecting the right data points, or updating them if your hostname scheme changes, etc.

Rapzid 12y ago
I use it heavily as well to create generic dashboards for looking at clusters/sites, etc. Its a shame kibana4 nerf'd templating :|
Florin_Andrei 12y ago
In an autoscaling environment, you just need to keep your metric paths consistent. Then all you need is wildcard queries. E.g., CPU userspace cycles on all your instances should be like: provider.region.vpc.group.instance-id.os.cpu.user E.g.: aws.us-west-1.prod.web-front.i-4df567a9.os.cpu.user Then wildcard queries will provide you aggregate stats at any level you like. It's really a feature of how Graphite queries work. -------------------- All that being said, I agree that Grafana is pretty awesome.
- phildougherty 12y ago
  That's true. I guess what I prefer about doing it in Grafana is that the interface for managing complex graphs with overlays of different metrics, and ones using wildcards to match groups of metrics is just way easier.

simonpantzare 12y ago

Very nice, congrats on the release! Had it up and running and our Grafana 1.x dashboards imported in about 15min. I was intrigued reading about the plans for alert support. Any pointers on where to start looking for somebody that may want to help build it? :) Would love to buy a coffee or beer some time in Stockholm.

torkelo 12y ago
That is awesome (that the upgrade was that smooth). I am going this meetup at DICE on Thursday, https://sites.google.com/site/stockholmgtug/Home/20150423 https://sites.google.com/site/stockholmgtug/Home/20150423

Rygu 12y ago

> The Graph panel now supports 3 logarithmic scales, log base 10, log base 32, log base 1024. Logarithmic y-axis scales are very useful when rendering many series of different order of magnitude on the same scale (eg. latency, network traffic, and storage) Have been waiting eagerly for logarithmic scale support.

bbrazil 12y ago
What's base 32 used for?
- torkelo 12y ago
  Useful for display series that represent storage space or IO, get get y axis ticks like 1 KB, 32KB, 1MB, 32MB, 1GB http://play.grafana.org/dashboard/db/new-features-in-v20?panelId=2&fullscreen http://play.grafana.org/dashboard/db/new-features-in-v20?pan...

anton_gogolev 12y ago

On a very tangentially related note: we've recently open-sourced our .NET port of StatsD/Graphite and it's available under MIT license at https://bitbucket.org/aeroclub-it/statsify https://bitbucket.org/aeroclub-it/statsify

torkelo 12y ago
interesting! I am working on a windows build of grafana 2 right now. Does statsify have a /render and /metrics/find api that is compatible with graphite? If it had grafana could use it.
- anton_gogolev 12y ago
  It has something similar to "/render"[0], but it's not Graphite-compatible. There's also support for "/find", but it is currently not the part of the public API. Adding Graphite-compatible endpoints should be fairly easy and this can really open up a lot of integration opportunities. [0]: https://bitbucket.org/aeroclub-it/statsify/wiki/Home#markdown-header-retrieving-graphing-and-analyzing-metrics https://bitbucket.org/aeroclub-it/statsify/wiki/Home#markdow...
  - torkelo 12y ago
    Could you move that project to github? I think that project has great potential coupled with Grafana. I will add windows builds to the install and download pages today. Here is a windows build for grafana 2.0.1 https://s3.amazonaws.com/grafanarel/winbuilds/dist/grafana-2.0.1.windows-x64.zip https://s3.amazonaws.com/grafanarel/winbuilds/dist/grafana-2...

BrainInAJar 12y ago

iframe embedded graphs would've helped me out immensely 8 months ago, So happy to see them now

kstenerud 12y ago

One quick note to people writing release notes pages: Often these pages get posted to news aggregators, and the people who click on those links are not as likely to be familiar with your product. A quick 1-2 line elevator pitch at the top would do wonders.

sean_the_geek 12y ago
Couldn't' agree more! I am interested but struggling to get exactly what it does..is it like Gephi..who knows???
kbody 12y ago
Although, I disagree, there is a note on the sidebar.

distantsounds 12y ago

What's the recommended backend for this? I tried it with InfluxDB but felt that the feature set wasn't really up there, I couldn't get graphs to display the data I wanted. We have a graphite instance elsewhere but it's running into disk space issues - will that be an issue here, too?

lifeisstillgood 12y ago
Graph an is a wholly JavaScript "chart display" front end that hacienda onto a grpahite-query-compatible server. This is usually the graphite server that usually is storing rrd data into a carbon database. However there are it seems a wide variety of choices. My view is if any form of column orientated data structure is struggling, try sharding your time series long before you swap technologies.

T-A 12y ago

I wanted to try http://docs.grafana.org/v2.0/installation/windows/ http://docs.grafana.org/v2.0/installation/windows/ but when I click the "build from source" link, I get "Sorry, page not found.". :(

torkelo 12y ago
strange works now.

dyb 12y ago

ElasticSearch was one of the data sources to grafana [1.8.1]. I do not see anything that points to "still works" in the docs. Has this changed?