3 ms·

Wikimedia's Public Grafana Instance

24 points by KomoD 4y ago

KomoD 4y ago
They have so much monitoring, a lot of pretty interesting dashboards My fav so far is authentication metrics: https://grafana.wikimedia.org/d/000000004/authentication-metrics?orgId=1&from=now-5y&to=now https://grafana.wikimedia.org/d/000000004/authentication-met...
rektide 4y ago
I really wish monitoring systems were more visible on the net. I'd really like for the cellular system to have public monitoring. Knowing how healthy the spectrum is, knowing how much capacity is available and used... being able to see into the world about us, learn what's happening is the root of what made humans so great, in my view, and this is such a rich layer that we owe to ourselves to have visible, appreciateable.
- KomoD 4y ago
  YES! I agree, I love when data like this is available, rare, but when it is, it's really cool. Not so long ago I went to a few internet exchanges' sites and discovered some of them publish stats, I think it's pretty cool to see stuff like bits per second, packets per second, etc.
duffyjp 4y ago
It looks like they use Graphite for their time-series database. I love Grafana but fell out with InfluxDB when they rewrote everything in 2.0. Everybody seems to recommend Victoria Metrics these days but I found it too difficult to build the queries I wanted. InfluxDB 1.x with Grafana was something you could teach an intern how to use in a day or two. I'll have to give Graphite a shot one of these days. * https://gerrit.wikimedia.org/g/operations/puppet/+/production/hieradata/common/profile/statograph.yaml#9 https://gerrit.wikimedia.org/g/operations/puppet/+/productio...
- starkparker 4y ago
  I'm surprised that they're still using Puppet with Hiera.
- dengolius 4y ago
  Hey! I recommend to check post from VictoriaMetrics CTO https://valyala.medium.com/promql-tutorial-for-beginners-9ab455142085 https://valyala.medium.com/promql-tutorial-for-beginners-9ab... and this guide https://docs.victoriametrics.com/guides/migrate-from-influx.html https://docs.victoriametrics.com/guides/migrate-from-influx..... Also there is nice post from Logz.io https://logz.io/blog/influxql-to-promql-grafana-dashboard-converter-open-source/#converting https://logz.io/blog/influxql-to-promql-grafana-dashboard-co... which contain a converter https://github.com/logzio/influxql-to-promql-converter https://github.com/logzio/influxql-to-promql-converter
zX41ZdbW 4y ago
I've recently presented a talk about making a real-time dashboard on top of Wikipedia pageviews (0.5 trillion records) with a single machine, <2 bytes per record, and zero amount of sophistication: https://www.youtube.com/watch?v=JlcI2Vfz_uk https://www.youtube.com/watch?v=JlcI2Vfz_uk

24 points by KomoD 4y ago

They have so much monitoring, a lot of pretty interesting dashboards My fav so far is authentication metrics: https://grafana.wikimedia.org/d/000000004/authentication-metrics?orgId=1&from=now-5y&to=now https://grafana.wikimedia.org/d/000000004/authentication-met...

rektide 4y ago

I really wish monitoring systems were more visible on the net. I'd really like for the cellular system to have public monitoring. Knowing how healthy the spectrum is, knowing how much capacity is available and used... being able to see into the world about us, learn what's happening is the root of what made humans so great, in my view, and this is such a rich layer that we owe to ourselves to have visible, appreciateable.

KomoD 4y ago
YES! I agree, I love when data like this is available, rare, but when it is, it's really cool. Not so long ago I went to a few internet exchanges' sites and discovered some of them publish stats, I think it's pretty cool to see stuff like bits per second, packets per second, etc.

duffyjp 4y ago

It looks like they use Graphite for their time-series database. I love Grafana but fell out with InfluxDB when they rewrote everything in 2.0. Everybody seems to recommend Victoria Metrics these days but I found it too difficult to build the queries I wanted. InfluxDB 1.x with Grafana was something you could teach an intern how to use in a day or two. I'll have to give Graphite a shot one of these days. * https://gerrit.wikimedia.org/g/operations/puppet/+/production/hieradata/common/profile/statograph.yaml#9 https://gerrit.wikimedia.org/g/operations/puppet/+/productio...

starkparker 4y ago
I'm surprised that they're still using Puppet with Hiera.
dengolius 4y ago
Hey! I recommend to check post from VictoriaMetrics CTO https://valyala.medium.com/promql-tutorial-for-beginners-9ab455142085 https://valyala.medium.com/promql-tutorial-for-beginners-9ab... and this guide https://docs.victoriametrics.com/guides/migrate-from-influx.html https://docs.victoriametrics.com/guides/migrate-from-influx..... Also there is nice post from Logz.io https://logz.io/blog/influxql-to-promql-grafana-dashboard-converter-open-source/#converting https://logz.io/blog/influxql-to-promql-grafana-dashboard-co... which contain a converter https://github.com/logzio/influxql-to-promql-converter https://github.com/logzio/influxql-to-promql-converter

zX41ZdbW 4y ago

I've recently presented a talk about making a real-time dashboard on top of Wikipedia pageviews (0.5 trillion records) with a single machine, <2 bytes per record, and zero amount of sophistication: https://www.youtube.com/watch?v=JlcI2Vfz_uk https://www.youtube.com/watch?v=JlcI2Vfz_uk