4 ms·
Hi. I have a question. I have put some time trying to learn the Grafana stack. Heaviness of elastic both self hosted and cloud version has led me to seek for
by jarpineh 5y ago
Hi.
I have a question. I have put some time trying to learn the Grafana stack. Heaviness of elastic both self hosted and cloud version has led me to seek for alternatives. Is there a way to get logs into Loki that can be run offline, when jobs have finished and hosts have been shutdown? It seems Loki recommends Promtail agent which looks a bit heavy-handed (https://grafana.com/docs/loki/latest/getting-started/get-logs-into-loki/ https://grafana.com/docs/loki/latest/getting-started/get-log... )
I have relaxed requirements on gathering logs for analytics. I’d much rather just run a tool that goes through log files and ingests them into Loki. Results of several jobs would be compared as a whole.
From what I’ve seen Loki with Grafana can do a lot. For example this video: https://m.youtube.com/watch?v=7zmRhHd-ohk https://m.youtube.com/watch?v=7zmRhHd-ohk
Thank you!
- buro9 5y agoOne of the engineers has suggested trying: ```cat <files> | promtail -stdin``` Though we like the idea as a feature request... "Have promtail support reading a file or directory and exiting once complete". So we've put that on the plan.
- jarpineh 5y agoAh, my thanks. I had somehow understood Promtail wrong. Its name, mention of Prometheus, scraping and such first tells me it's closer to something like node exporter. I had watched Loki release presentation and few others, but managed to still misunderstand. Oh well. Now, things make more sense. Moving forward with the installation... :)
- buro9 5y agoPromtail is a process that watches a directory and effectively tails the files and sends them to Loki. Agree that the name isn't ideal as it's not clear that this is a "tail and send text files" process. But yup, Promtail is what you want.