3 ms·
Prometheus' own docs say that distributed evaluation is "deemed infeasible".
by jeffbee 5y ago
Prometheus' own docs say that distributed evaluation is "deemed infeasible".
- dilyevsky 5y agoThats just like.. you know.. their opinion, man. https://prometheus.io/docs/prometheus/latest/federation/ https://prometheus.io/docs/prometheus/latest/federation/
- bpicolo 5y agoPrometheus federation isn't distributed evaluation. It "federates" from other nodes onto a single node. > Federation allows a Prometheus server to scrape selected time series from another Prometheus server
- dilyevsky 5y agoCollect directly from shard-level prometheus then aggregate using /federate at another level. That’s how thanos also works afaik
- hiptobecubic 5y agoThis still requires the query to fit on a single node at some point unless you're doing multi-level aggregation. Monarch does that. Being able to push expensive, highly-parallelizable aspects of the query down into the leaves is a massive benefit.
- dilyevsky 5y agoYep, in theory it’s great if you can afford a team of highly qualified engs to run it like google and dealing with huge metrics. In practice I found it was not hard to crash a monarch mixer (at least some years ago) + most orgs won’t be able to afford nor take advantage of it