5 ms·

Grafana Labs Observability Survey 2024

20 points by shahargl 3y ago

jasonjmcghee 3y ago
Do you think 91% of people using grafana is an accurate figure? Seems very high.
- Cwizard 3y ago
  91% of people that filled in their survey I think.
- buro9 3y ago
  I work at Grafana, and just attended KubeCon, even when not near the booth but just in Grafana t-shirts I was stopped frequently by individuals saying how much they love Grafana, how it just works, how we should just keep doing what we're doing... there's strong signal there (though this is KubeCon, and K8s isn't the whole industry by a long shot). But even I would rationally question the survey results, as like all surveys it would only represent those surveyed. If you scroll to the bottom of the article there is a section "About the respondents and methodology" and to quote, "This year, 306 people participated in the Grafana Labs Observability Survey. We did not contract an outside agency to solicit responses. Instead, we reached out to our community to participate, through our website, social media, and at various Grafana Labs and OSS events". So let's be upfront here, it's a biased and small sample, but the consistent methodology with prior years means that the directional trends can be identified, even if you cannot extrapolate any specific number to the whole industry. The indicative signals in there for trends and direction... but it's not quite a 100K audience from all industries and representative of wider engineering. The number is high due to who was asked to respond.
  - jasonjmcghee 3y ago
    I personally chose and use grafana. Not commenting on whether or not people should use it. 91% of people claimed to do anything gives me pause. The only place Datadog was mentioned was in invisible text. (Search the page) Which seems absolutely crazy to me
- brylie 3y ago
  As another commenter pointed out, this survey probably suffers from selection bias https://en.wikipedia.org/wiki/Selection_bias https://en.wikipedia.org/wiki/Selection_bias
- dijit 3y ago
  I dont have any reason to think it’s inaccurate. What alternative dashboards are there? I have even seen it used in demos where the host works for a company that has a first party dashboard product. (google, amazon etc)
  - jasonjmcghee 3y ago
    Many. Datadog, New Relic, SigNoz, etc. Search for "grafana alternatives"
    - pranay01 3y ago
      Thanks for mentioning SigNoz. Here's our github repo in case anyone wants to check it out - https://github.com/signoz/signoz https://github.com/signoz/signoz
  - nikolay_sivko 3y ago
    Take a look at https://github.com/coroot/coroot https://github.com/coroot/coroot (Apache 2.0). It offers plenty of ready-to-use dashboards and inspections
- tootie 3y ago
  And zero use New Relic?
- pranay01 3y ago
  .. Of Grafana labs , by Grafana labs, for Grafana labs :)
palijer 3y ago
>About the respondents and methodology. This year, 306 people participated in the Grafana Labs Observability Survey. We did not contract an outside agency to solicit responses. Instead, we reached out to our community to participate, through our website, social media, and at various Grafana Labs and OSS events. This should be right at the top as it indicates a substantial bias in the data. Calling this survey "Key findings and analysis on the state of observability" is disingenuous at best with that methodology. If this team realistically thinks this small sample size and narrow grouping gives an accurate analysis of the big picture, I would be hesitant about any analysis their product can provide.
- yjftsjthsd-h 3y ago
  In light of that, I'm surprised that only 91% said they used grafana. How did the other 9% even get in to the survey?
  - nemo44x 3y ago
    A lot of software is purchased that never gets used. Sometimes the managerial sponsee leaves the company after acquiring the software for instance. The vendor will update their CRM with a new contact. Or, the vendor is trying to expand a customer and has new contacts in other parts of the company that haven’t converted yet. Or a customer that had converted but has not yet deployed. They could still be working with customer education and consulting services and/or CSM to get their deployment squared.
nemo44x 3y ago
This is just a piece of marketing material - it's the survey of ~300 Grafana customers. Congrats to Grafana for getting their advertisement posted to this Website.
deleted 3y ago
[deleted]
tmd83 3y ago
There seems to be newer players both open source and commercial now. But a lot of the focus seems in metric and specially distributed traces. Does anyone in the open source do code level profiling (cpu, allocation, locks etc.) preferably sampling profiler (including Java)? I have only really found pyroscope.
- jasonjmcghee 3y ago
  Search for eBPF (continuous) profiling. Grafana supports this through their agent, for example. (I've never used it, just found it after a quick search)

20 points by shahargl 3y ago

jasonjmcghee 3y ago

Do you think 91% of people using grafana is an accurate figure? Seems very high.

Cwizard 3y ago
91% of people that filled in their survey I think.
buro9 3y ago
I work at Grafana, and just attended KubeCon, even when not near the booth but just in Grafana t-shirts I was stopped frequently by individuals saying how much they love Grafana, how it just works, how we should just keep doing what we're doing... there's strong signal there (though this is KubeCon, and K8s isn't the whole industry by a long shot). But even I would rationally question the survey results, as like all surveys it would only represent those surveyed. If you scroll to the bottom of the article there is a section "About the respondents and methodology" and to quote, "This year, 306 people participated in the Grafana Labs Observability Survey. We did not contract an outside agency to solicit responses. Instead, we reached out to our community to participate, through our website, social media, and at various Grafana Labs and OSS events". So let's be upfront here, it's a biased and small sample, but the consistent methodology with prior years means that the directional trends can be identified, even if you cannot extrapolate any specific number to the whole industry. The indicative signals in there for trends and direction... but it's not quite a 100K audience from all industries and representative of wider engineering. The number is high due to who was asked to respond.
- jasonjmcghee 3y ago
  I personally chose and use grafana. Not commenting on whether or not people should use it. 91% of people claimed to do anything gives me pause. The only place Datadog was mentioned was in invisible text. (Search the page) Which seems absolutely crazy to me
brylie 3y ago
As another commenter pointed out, this survey probably suffers from selection bias https://en.wikipedia.org/wiki/Selection_bias https://en.wikipedia.org/wiki/Selection_bias
dijit 3y ago
I dont have any reason to think it’s inaccurate. What alternative dashboards are there? I have even seen it used in demos where the host works for a company that has a first party dashboard product. (google, amazon etc)
- jasonjmcghee 3y ago
  Many. Datadog, New Relic, SigNoz, etc. Search for "grafana alternatives"
  - pranay01 3y ago
    Thanks for mentioning SigNoz. Here's our github repo in case anyone wants to check it out - https://github.com/signoz/signoz https://github.com/signoz/signoz
- nikolay_sivko 3y ago
  Take a look at https://github.com/coroot/coroot https://github.com/coroot/coroot (Apache 2.0). It offers plenty of ready-to-use dashboards and inspections
tootie 3y ago
And zero use New Relic?
pranay01 3y ago
.. Of Grafana labs , by Grafana labs, for Grafana labs :)

palijer 3y ago

>About the respondents and methodology. This year, 306 people participated in the Grafana Labs Observability Survey. We did not contract an outside agency to solicit responses. Instead, we reached out to our community to participate, through our website, social media, and at various Grafana Labs and OSS events. This should be right at the top as it indicates a substantial bias in the data. Calling this survey "Key findings and analysis on the state of observability" is disingenuous at best with that methodology. If this team realistically thinks this small sample size and narrow grouping gives an accurate analysis of the big picture, I would be hesitant about any analysis their product can provide.

yjftsjthsd-h 3y ago
In light of that, I'm surprised that only 91% said they used grafana. How did the other 9% even get in to the survey?
- nemo44x 3y ago
  A lot of software is purchased that never gets used. Sometimes the managerial sponsee leaves the company after acquiring the software for instance. The vendor will update their CRM with a new contact. Or, the vendor is trying to expand a customer and has new contacts in other parts of the company that haven’t converted yet. Or a customer that had converted but has not yet deployed. They could still be working with customer education and consulting services and/or CSM to get their deployment squared.

nemo44x 3y ago

This is just a piece of marketing material - it's the survey of ~300 Grafana customers. Congrats to Grafana for getting their advertisement posted to this Website.

deleted 3y ago

[deleted]

tmd83 3y ago

There seems to be newer players both open source and commercial now. But a lot of the focus seems in metric and specially distributed traces. Does anyone in the open source do code level profiling (cpu, allocation, locks etc.) preferably sampling profiler (including Java)? I have only really found pyroscope.

jasonjmcghee 3y ago
Search for eBPF (continuous) profiling. Grafana supports this through their agent, for example. (I've never used it, just found it after a quick search)