4 ms·
Why is everyone ok with logs being dumped like it's in a trash can? I see partial structures and then JSON string as is and then some long blob of string no on
by mekster 5y ago
Why is everyone ok with logs being dumped like it's in a trash can?
I see partial structures and then JSON string as is and then some long blob of string no one can understand what it is with no new lines.
What devs want are pretty simple, structured log with table layout without repeating the column names on every row to make it look insanely verbose for any human to consume.
I'm picking up bits of open source apps to build a decent solution with Vector (which has awesome Vector remap language to parse strings into structured data if it isn't already) and throw it into ClickHouse to view it from Metabase.
Apparently, Kibana, Graylog or even Grafana are pretty bad at displaying logs to even feel tiny comfortable reading it every day.
Logging is such a crucial part of developer life and not sure why that there aren't any sane open source solutions.
- tchiotludo 5y agoSorry I don't understand, we display with pretty print, see here : https://kestra.io/assets/img/05.8b5545ef.png https://kestra.io/assets/img/05.8b5545ef.png It's not as json ? or I don't understand where you see that.
- nerdponx 5y agoI think the point is that logs should have a well-defined structure that can be easily parsed and queried by other programs.
- mekster 5y agoThis is what I see on the first page of the log in your demo. https://imgur.com/a/S1QkzuG https://imgur.com/a/S1QkzuG It can look a bit better with more config for these 3 other tools but these are pretty much what they're and the readability isn't any better than tail/grep. - Graylog : https://adamtheautomator.com/wp-content/uploads/2022/02/image-162.png https://adamtheautomator.com/wp-content/uploads/2022/02/imag... - Grafana : https://grafana.com/static/assets/img/blog/logcontext_explore.png https://grafana.com/static/assets/img/blog/logcontext_explor... - Kibana : https://blog.ip2location.com/wp-content/uploads/2018/12/logstash-filter-ip2location-screenshot.png https://blog.ip2location.com/wp-content/uploads/2018/12/logs... Comapred to displaying structured logs in Metabase. (This isn't text logs but you get the point.) - https://www.predictiveanalyticstoday.com/wp-content/uploads/2017/06/Metabase-1000x547.jpg https://www.predictiveanalyticstoday.com/wp-content/uploads/...
- tchiotludo 5y agoOk got it, every task type are able to logged what they want, so basically, there is one task that is sending dirty output, I add a fix on the roadmap in order to clean this task, thanks for the report