3 ms·
I'm looking for this but can't find it, how does this project compare to differential dataflow? As a sibling commenter mentioned, it's built on timely dataflow
by cube2222 3y ago
I'm looking for this but can't find it, how does this project compare to differential dataflow?
As a sibling commenter mentioned, it's built on timely dataflow (which is lower-level), but that already has differential dataflow[0] built on top of it by the same authors.
How do they differ?
(btw. I think dataflow is very cool as a computing model (not just timely dataflow), to the point of building OctoSQL[1] around it, so I'm really curious about the details here)
[0]: https://github.com/TimelyDataflow/differential-dataflow https://github.com/TimelyDataflow/differential-dataflow
[1]: https://github.com/cube2222/octosql https://github.com/cube2222/octosql
- jcelerier 3y ago> how does this project compare to differential dataflow? I may ask a stupid question, but from reading the description on the page you linked, how are timely and differential dataflow different from implementation details of 80s reactive programming such as SIGNAL (https://ieeexplore.ieee.org/document/97301 https://ieeexplore.ieee.org/document/97301) ? > Differential dataflow programs look like many standard "big data" computations, borrowing idioms from frameworks like MapReduce and SQL. However, once you write and run your program, you can change the data inputs to the computation, and differential dataflow will promptly show you the corresponding changes in its output. Promptly meaning in as little as milliseconds.
- cube2222 3y agoI think it's best to read the paper[0]. [0]: https://sigops.org/s/conferences/sosp/2013/papers/p439-murray.pdf https://sigops.org/s/conferences/sosp/2013/papers/p439-murra...