4 ms·

I would ask this a different way--is there a single OSS project that handles collecting all of the OTEL metrics/logs/traces? Folks keep saying you can't do thi

I would ask this a different way--is there a single OSS project that handles collecting all of the OTEL metrics/logs/traces? Folks keep saying you can't do this in data store/format, Elastic seems to, and having to manage separate storage/infrastructure for all of these tools is intense. Could Prometheus be augmented to store metrics, logs, and traces somehow? I don't really mind if it doesn't scale well on a single instance or is highly available, I'll just add more instances and aggregate them.

kortex 3y ago
It's really not that intense. I basically set up my last co's telemetry infrastructure all by myself, using terraform, otel-python, jaeger, and AWS elasticsearch. This TF project does most of the heavy lift. https://github.com/telia-oss/terraform-aws-jaeger https://github.com/telia-oss/terraform-aws-jaeger
- candiddevmike 3y ago
  Jaeger for tracing, Elasticsearch for logs? What are you using for metrics?
  - mmclean 3y ago
    Likely Prometheus - Jaeger for tracing, Elastic for logs, Prometheus for metrics is a pretty common and effective OSS observability stack
CubsFan1060 3y ago
I've been watching this with a lot of interest: https://signoz.io/ https://signoz.io/
- candiddevmike 3y ago
  That looks really promising, thank you for sharing it
  - pranay01 3y ago
    Great to hear that. I am one of the maintainers at SigNoz - if you have any queries as you implement , do ask in our slack - https://signoz.io/slack https://signoz.io/slack
Svenstaro 3y ago
I guess you could take a look at this: https://openobserve.ai/ https://openobserve.ai/ It's in Rust to add some HN catnip.
- candiddevmike 3y ago
  Why .ai?
  - deleted 3y ago
    [deleted]
- esafak 3y ago
  Have you used it? How does it stack up?
  - Svenstaro 3y ago
    Haven't used it yet, I'm a bit too scared to put something like this into production anywhere. I might do a small installation with a toy project somewhere, though. Seems easy enough to set up.

kortex 3y ago

It's really not that intense. I basically set up my last co's telemetry infrastructure all by myself, using terraform, otel-python, jaeger, and AWS elasticsearch. This TF project does most of the heavy lift. https://github.com/telia-oss/terraform-aws-jaeger https://github.com/telia-oss/terraform-aws-jaeger

candiddevmike 3y ago
Jaeger for tracing, Elasticsearch for logs? What are you using for metrics?
- mmclean 3y ago
  Likely Prometheus - Jaeger for tracing, Elastic for logs, Prometheus for metrics is a pretty common and effective OSS observability stack

CubsFan1060 3y ago

I've been watching this with a lot of interest: https://signoz.io/ https://signoz.io/

candiddevmike 3y ago
That looks really promising, thank you for sharing it
- pranay01 3y ago
  Great to hear that. I am one of the maintainers at SigNoz - if you have any queries as you implement , do ask in our slack - https://signoz.io/slack https://signoz.io/slack

Svenstaro 3y ago

I guess you could take a look at this: https://openobserve.ai/ https://openobserve.ai/ It's in Rust to add some HN catnip.

candiddevmike 3y ago
Why .ai?
- deleted 3y ago
  [deleted]
esafak 3y ago
Have you used it? How does it stack up?
- Svenstaro 3y ago
  Haven't used it yet, I'm a bit too scared to put something like this into production anywhere. I might do a small installation with a toy project somewhere, though. Seems easy enough to set up.