4 ms·
A short answer: It's a recent approach to incremental computation geared towards data-science/db people. Imagine you want to maintain the connected components o
by moab 10y ago
A short answer: It's a recent approach to incremental computation geared towards data-science/db people. Imagine you want to maintain the connected components of a graph where edges are being added and removed. It turns out you can express this using dataflow and get reasonable looking runtimes (30,000 edge ins/del per second) [1]. You could probably do much better with a careful implementation of parallel union-find for just edge-insertions but part of the appeal of data-flow is that you express your computation using functional primitives like joins, maps and filters and then the incremental stuff 'just works'.
[1] http://www.frankmcsherry.org/differential/dataflow/2015/05/12/bfs.html http://www.frankmcsherry.org/differential/dataflow/2015/05/1...
- shoo 10y agothis kind of thing might be interesting for local search algorithms where you want to explore different variations / adjustments of a particular structure and want to maintain some kind of topological invariants while you are doing so. E.g. search the neighbourhood of a given tree by adding / deleting edges, while preserving that what you get is in fact still a tree