4 ms·
How would you efficiently keep continuously updated complex metrics (aggregations, windowed functions, etc) calculated on top of unbounded/streaming data using
by mvitorino 7y ago
How would you efficiently keep continuously updated complex metrics (aggregations, windowed functions, etc) calculated on top of unbounded/streaming data using a database? I'm not saying that Spark is the ideal solution, but there are a set of problems that require tools such as Spark.
- truth_seeker 7y agoOne example could be PipelineDB extension for PostgreSQL http://docs.pipelinedb.com/introduction.html http://docs.pipelinedb.com/introduction.html
- bsg75 7y agohttps://www.pipelinedb.com/blog/pipelinedb-is-joining-confluent https://www.pipelinedb.com/blog/pipelinedb-is-joining-conflu...
- truth_seeker 7y agoI know. But at the same time, 1.0 is pretty much capable. Give it a try and you will realize it.