4 ms·
So then whatever process maintains the snapshots of input data must absorb all of the complexity eliminated from the workers, no?
by orangepenguin 8y ago
So then whatever process maintains the snapshots of input data must absorb all of the complexity eliminated from the workers, no?
- abadid 8y agoMulti-versioned systems can read from a snapshot at negligible complexity (just read the correct version).
- orangepenguin 8y agoAnd is the snapshot system also distributed and highly available? If so, wouldn't it take on the challenges of committing changes?
- abadid 8y agoThere is no separate snapshot system. Each partition just maintains multiple versions of all data it stores locally.
- acqq 8y agoDo I understand then correctly that the: temp = Do_Remote_Read(Y) if (temp > 0) X = 42 Is actually temp = Do_Remote_Read(Y_i) if (temp > 0) X = 42 where Y_i is the value of Y in the version i that matches the version for which the coordinator created the code? Otherwise Y can be something else? And isn't then there a need for a synchronization with the keeper of Y, if Y_i is still not available?
- abadid 8y agoYes, but it is possible to architect the system such that Y_i is available.
- acqq 8y ago> it is possible to architect the system such that Y_i is available. I'd really like to know how? How can we be sure that the keeper of Y is ready (or even online) at the Read moment? (As you see I'm not familiar with the systems you worked on but I'd really like to understand the context in which you present the solution).
- abadid 8y agoI think I misunderstood what you were saying. By "available" I mean that the version exists at the time of the read. As far as available wrt failure, this is no different than any other system. If you don't synchronously replicate data, you can cannot process transactions over data that is offline (and still guarantee ACID). The transaction cannot proceed whether or not you are using 2PC.
- hodgesrm 8y agoThat's exactly where I got stuck on the example. (Saved me editing my comment. Thanks!)
- warkdarrior 8y ago> (just read the correct version) Famous last words!