3 ms·
Scribe is the Facebook-internal Kafka equivalent. LogDevice is the storage layer used by Scribe. Scribe isn’t the only place where LogDevice is used though — F
by pdpi 8y ago
Scribe is the Facebook-internal Kafka equivalent. LogDevice is the storage layer used by Scribe.
Scribe isn’t the only place where LogDevice is used though — Facebook has documented using it for TAO as well (as part of the secondary indices)
- saryant 8y agoI don't believe Scribe and Kafka are equivalent. Isn't Scribe at-most-once? Unless we're talking about two different projects named Scribe, which is certainly possible.
- lclarkmichalek 8y agoScribe doesn't really make decisions about that, it doesn't store checkpoints for readers. Readers are commonly more-than-once.
- pdpi 8y ago> Scribe doesn't really make decisions about that It kind of does, on the write pipeline. Tailers vary, but scribed controls the semantics of how your message gets delivered to LogDevice.
- pdpi 8y agoAs lclarkmichalek said, there’s more than one way to skin a cat. At any rate, I used “equivalent” here to mean that, while different trade-offs have been made, it has the sort of users building the same sort of applications on the same sort of abstractions — it plays the same role, for all intents and purposes.