3 ms·
Does it still apply that if my Prometheus goes down or network glitches then metrics for that period is lost forever?
by ranting-moth 3y ago
Does it still apply that if my Prometheus goes down or network glitches then metrics for that period is lost forever?
- gouthamve 3y agoUnfortunately, yes. The OTel Collector has plans to implement a WAL for the OTLP exporter and when it does, you should be resilient to upstream temporarily having issues.
- SideburnsOfDoom 3y agoWAL = Write-Ahead Logging ?
- gouthamve 3y agoYes sorry
- worserer 3y agoIt does today. You have a retry queue and you can use a persistent storage for it.
- ranting-moth 3y agoHow will that affect timestamps, won't all the metrics have the timestamp as the time when Prometheus finally receives them?
- kbouck 3y agoWhat are the merits of the prometheus approach versus one where events/metrics and their original timestamps can be preserved, stored (during temporary outages), then forwarded to backends when connectivity is reestablished?