3 ms·
I'm trying to understand your proposed system (as a non CS person). Would this be an accurate (basic) description of it? - You keep a deterministic log of all
by ThePhysicist 8y ago
I'm trying to understand your proposed system (as a non CS person). Would this be an accurate (basic) description of it?
- You keep a deterministic log of all data inputs / transactions that should take place (a write-ahead log of sorts) that all workers can refer to.
- Each worker remembers the position in the log that it has processed so far.
- If a worker crashes during a transaction it can simply pick up at the position it was at before (possibly after doing some local cleanup) and replay the transactions.
- abadid 8y agoWhat you said is one reasonable way to accomplish what is stated in the post. There are other alternatives (described in the links from the post), but your way would work fine.