2 ms·
You paper "A catalog of stream processing optimizations" is great! It seems like a classic in stream processing for me :) Generally I agree with this comment.
by zekrioca 26d ago
You paper "A catalog of stream processing optimizations" is great! It seems like a classic in stream processing for me :)
Generally I agree with this comment. Very few niche applications require stream processing and all struggle that had been into research to enable some of the ACID properties for stream processing.
While at it, would you know how kdb+ (mostly used in finance) work? It -- together with q -- seems to achieve very low latency for real time systems.
- jasonwatkinspdx 24d agoI only kicked the tires on kdb ages ago, so this may be out of date. At the time k's speed came from holding time series data in memory as simple dense arrays. The language treats a vector operation like z[] = x[] + y[] as a single operation, and so executes it as one step in the interpreter loop. The actual operation logic is just compiled c code. So despite being a very simple lisp like language, its array orientation lets it be surprisingly speedy for certain kinds of data crunching.