3 ms·
"They charge $2,800 to store a TB" !!! good god Totally agree about the compressibility of metrics and toying with the scraping interval. I started out working
by paigerduty 3y ago
"They charge $2,800 to store a TB" !!! good god
Totally agree about the compressibility of metrics and toying with the scraping interval. I started out working for an enterprise monitoring vendor that had a proprietary agent that already decided sane intervals to emit metrics, when I learned that Prometheus let users configure that to me...just sounds like an expensive foot gun.
My real beef with metrics is at least for app layer insights is the waste. I'd so much rather have a span/event configured with tail sampling so you can derive metrics from traces and tie them to logs in a native contextualized way vs having to do that correlation on the backend and within different systems and query langs. Seems much more efficient and cost-effective that way, I'm scarred from seeing a zillion "service_name.http_response.p95.average" metrics that are imo useless
- jiggawatts 3y ago> for app layer insights is the waste. I’m starting to come to the same conclusion, but the point I’m making is a general one: efficient formats would allow finer grained telemetry to be collected without having to be tuned and carefully monitored. What’s the point of a monitoring system that itself needs baby sitting?!