4 ms·
History repeating again. Pre-big data, most event processing was done via SQL-92, some processing via custom procedural code, and the rest via DSLs like Drools
by karlunho 4y ago
History repeating again. Pre-big data, most event processing was done via SQL-92, some processing via custom procedural code, and the rest via DSLs like Drools and Esper. Post big-data, most processing is being done by Spark / Flink SQL, some via custom python code, and now Kasakada.
- benchambers 4y agoInteresting that you mention DSLs like Drools and Esper. One of the things we'd like to do is explore ways to bring the complex/composite event-processing (CEP) functionality to Kaskada. SQL does include "match recognize" at this point, but it is still pretty unwieldy to use. With the shift towards general event-processing, we'd really like Kaskada to make it easy to express queries like "how many times do X happen within an hour after Y with these properties" -- the kinds of things that Drools and Esper provided!