Another voice in favor of logging. At Morgan Stanley we wind up recording about 1TB/day of structured log data, which also needs an efficient query engine to p

Another voice in favor of logging. At Morgan Stanley we wind up recording about 1TB/day of structured log data, which also needs an efficient query engine to process. We carved a basic type system out for structured data, maps to C++ data well, and built a Haskell-like PL (and JIT compiler built on LLVM) to process it: https://github.com/Morgan-Stanley/hobbes/ https://github.com/Morgan-Stanley/hobbes/ The logging part is just a single self-contained header-only lib, so very easy to incorporate in existing systems.