10 ms·

I just wanted to add my favourite feature which is how easy it is to have high availability. I run all my Prometheus in pairs, each sending all metrics to two

I just wanted to add my favourite feature which is how easy it is to have high availability. I run all my Prometheus in pairs, each sending all metrics to two VM on-prem (Hetzner) servers. Here's the magic, each VM server will dedup metrics (remember, they are all coming from two Prom instances). This way you have a simple and reliable HA long retention storage. I only deal with 500k active series but I'd bet I can deal with 10-20x more with the same setup.

dedupnovice 4y ago
Can you explain more about the dedup feature? Does it require some kind of unique id from the source? Is it done on ingest or on query? Is that something included with VictoriaMetrics or a separate addon?
- pachico 4y ago
  It's a VM built-in feature at ingestion time. In case two independent Prometheus instances send the same metric within the same time interval, only the first one will be stored. https://docs.victoriametrics.com/Single-server-VictoriaMetrics.html https://docs.victoriametrics.com/Single-server-VictoriaMetri...