3 ms·
I've recently been pondering whether to create a log receiver that will produce Prometheus metrics as well as logs for Loki. Why? Because there are several op
by buro9 6y ago
I've recently been pondering whether to create a log receiver that will produce Prometheus metrics as well as logs for Loki.
Why?
Because there are several open source projects that if joined up in a relatively simple way would provide a full RUM / Analytics solution.
For collecting the analytics: Akamai Boomerang, which is a descendant of Yahoo tooling https://github.com/akamai/boomerang https://github.com/akamai/boomerang and BSD licensed
Then insert a collector that will produce Prometheus metrics and write log lines. The metrics will provide the timing information and in many ways will be richer than Google Analytics, and the log lines will provide the potentially high cardinality of string based data like user agents, URIs, etc and Grafana supports PromQL queries against logs such that you can gain metrics from the log lines too.
Then add in a free Grafana Cloud https://grafana.com/products/cloud/ https://grafana.com/products/cloud/ and configure Prometheus to scrape from the collector, and Loki to consume the logs.
This is an end-to-end cloud hosted RUM / Analytics solution that for a single user would be free and one can even add alerting.
The missing link is that collector, to consume the Boomerang output and produce Prometheus metrics and log lines for Loki.
All of this is open source and can be self hosted, the only piece you would have to host today would be that custom collector to receive the Boomerang requests.