4 ms·
Hi, thank you for the answer. Can you comment on how writes to the LogDevice servers are performed - particularly if the writes have to go through the sequence
by jbit84 9y ago
Hi, thank you for the answer.
Can you comment on how writes to the LogDevice servers are performed - particularly if the writes have to go through the sequencer, or if the individual producers can write directly after obtaining a LSN?
Since a given LogDevice server will only receive a non-deterministic sub-sequence of records, I would think it has to receive its set of writes in order? (To have enough information to push to clients in order). Unless there is actually some mechanism by which it can determine the elements it should receive.
Trying to understand if your per-log throughput will be capped by the max traffic that can be pushed through a single sequencer, or the round-trip latency for waiting for acknowledged writes from LogDevice servers.
- martincmartin 9y agoTrying to understand if your per-log throughput will be capped by the max traffic that can be pushed through a single sequencer, Yes. You can think of an individual log like a database shard. We have plans to allow the sequencer to just give out sequence numbers, and allow the clients to send the data directly to the storage nodes. But its not a high priority for us, since it's just a constant factor improvement. (Although a large one!) Users would still need to shard their data, although not as much.