4 ms·
It depends on what you want to do and how structured your log files are. My web servers write json records for each log event and that makes analysis sweet and
by epalmer 11y ago
It depends on what you want to do and how structured your log files are. My web servers write json records for each log event and that makes analysis sweet and easy. I have other log files that are just text seached through the records.
Splunk is free for up to 500mb of import a day. It has a web interface and I use it to analyze web log files and other log files. I used the free one for a while and then went to paid because of my daily imports were occasionally >500MB.
I like it for my needs.
- epalmer 11y agoThere is also grep and awk which I use for small log files as well. I've written python scripts for very specific time order dependency analysis. Basically throw away python.
- victorhooi 11y agoThat's a good point - I could probably write some Python to parse the logfiles, and convert it into a more structured form. One major use case - the logfiles contains records about files and events associated with those files - we want to trace each file over the span of the logfile. However, at the other end, I need a way to present it, and allow users to filter it, or select objects to trace - basically, if I could replicate something like Splunk or Kibana, either at the console or via a WebUI - I didn't know if there are UI frameworks/components out there that provided similar controls.
- tanlermin 11y agoUse python's bokeh: http://bokeh.pydata.org/en/latest/ http://bokeh.pydata.org/en/latest/ You can create interactive plots and webapps without writing javascript.