On (6), are you already using WCOJs and/or delta-based joins? If not, check out [0][1]. If you do, you might be interested in the LSM tree ideas [2] from when

On (6), are you already using WCOJs and/or delta-based joins? If not, check out [0][1]. If you do, you might be interested in the LSM tree ideas [2] from when arrangements where called `ValueHistory` to offload part of the memory usage to SSDs. [0]: https://github.com/TimelyDataflow/differential-dataflow/tree/master/dogsdogsdogs#worst-case-optimal-joins https://github.com/TimelyDataflow/differential-dataflow/tree... [1]: https://mtrlz.dev/api/rust/dogsdogsdogs/index.html https://mtrlz.dev/api/rust/dogsdogsdogs/index.html (3rd party rustdoc for convenience) [2]: https://github.com/TimelyDataflow/differential-dataflow/issues/82 https://github.com/TimelyDataflow/differential-dataflow/issu...