3 ms·
Thank you! The state Feldera maintains depends on the queries you write and the working set or windows you're computing over. Any time there are joins, distinc
by lsuresh 2y ago
Thank you!
The state Feldera maintains depends on the queries you write and the working set or windows you're computing over. Any time there are joins, distinct or non-linear aggregations, we need to maintain state as you've guessed.
A cool feature in Feldera is that it can compute over infinite streams with finite state because we automate garbage collection. The user specifies lateness over data sources or even views, and with some static analysis, Feldera determines when it is safe to forget old state such that it won't affect the output of any views.