3 ms·

You might enjoy http://db.cs.berkeley.edu/papers/eurosys10-boom.pdf http://db.cs.berkeley.edu/papers/eurosys10-boom.pdf . They put everything into tables (debug

by jamii 12y ago

You might enjoy http://db.cs.berkeley.edu/papers/eurosys10-boom.pdf http://db.cs.berkeley.edu/papers/eurosys10-boom.pdf . They put everything into tables (debug logs, profiling info, server state, monitoring statistics, messages sent/received etc) and then debug the system by writing queries on the tables.

gioele 12y ago
cat /var/log/syslog | grep -i 'problem' is also a query on the `/var/log/syslog` "database". What would be really cool is a RDBMS where the single pieces of data in the cells are related to each other. For example the user IDs in the authentication log could be matched with the IDs present in the request log.
- melling 12y ago
  Why add the extra cat command? grep -i 'problem' /var/log/syslog
  - coriny 12y ago
    He's after this weeks "Useless use of cat" award: http://www.smallo.ruhr.de/award.html#cat http://www.smallo.ruhr.de/award.html#cat Good to see there's still some competitors out there.
    - serve_yay 12y ago
      What a silly thing to complain about.
      - coriny 12y ago
        It was light hearted, comes with a smiley now :)
  - zem 12y ago
    pipelines read better left to right
    - Hello71 12y ago
      </var/log/syslog grep -i 'problem'
  - stonogo 12y ago
    because invariably you're going to want to recall this command from history and insert "grep -v HostnameIDontCareAbout" between the cat and the grep. or you're going to want to replace "grep -i 'problem'" with "awk '/problem/ { print $3 }". or you're going to want to do both. people whine about 'useless use of cat' like it's still 1982, but the fact is that it's convenient for iterative development of a pipeline in situ and it costs nothing.
- diltonm 12y ago
  Apache Drill lets you search logs using column base requirements. https://cwiki.apache.org/confluence/display/DRILL/Querying+a+File+System https://cwiki.apache.org/confluence/display/DRILL/Querying+a... It doesn't work on files with no extension yet or at least there's a bug report on it: https://issues.apache.org/jira/browse/DRILL-1320?filter=-3 https://issues.apache.org/jira/browse/DRILL-1320?filter=-3
- niutech 12y ago
  Have a look at lnav: http://tstack.github.io/lnav/ http://tstack.github.io/lnav/

by jamii 12y ago

gioele 12y ago

cat /var/log/syslog | grep -i 'problem' is also a query on the `/var/log/syslog` "database". What would be really cool is a RDBMS where the single pieces of data in the cells are related to each other. For example the user IDs in the authentication log could be matched with the IDs present in the request log.

melling 12y ago
Why add the extra cat command? grep -i 'problem' /var/log/syslog
- coriny 12y ago
  He's after this weeks "Useless use of cat" award: http://www.smallo.ruhr.de/award.html#cat http://www.smallo.ruhr.de/award.html#cat Good to see there's still some competitors out there.
  - serve_yay 12y ago
    What a silly thing to complain about.
    - coriny 12y ago
      It was light hearted, comes with a smiley now :)
- zem 12y ago
  pipelines read better left to right
  - Hello71 12y ago
    </var/log/syslog grep -i 'problem'
- stonogo 12y ago
  because invariably you're going to want to recall this command from history and insert "grep -v HostnameIDontCareAbout" between the cat and the grep. or you're going to want to replace "grep -i 'problem'" with "awk '/problem/ { print $3 }". or you're going to want to do both. people whine about 'useless use of cat' like it's still 1982, but the fact is that it's convenient for iterative development of a pipeline in situ and it costs nothing.
diltonm 12y ago
Apache Drill lets you search logs using column base requirements. https://cwiki.apache.org/confluence/display/DRILL/Querying+a+File+System https://cwiki.apache.org/confluence/display/DRILL/Querying+a... It doesn't work on files with no extension yet or at least there's a bug report on it: https://issues.apache.org/jira/browse/DRILL-1320?filter=-3 https://issues.apache.org/jira/browse/DRILL-1320?filter=-3
niutech 12y ago
Have a look at lnav: http://tstack.github.io/lnav/ http://tstack.github.io/lnav/