15 ms·
So they're using Scylla to manually do what kafka does, basically processors polling for new records in a shard and updating their watermark once its done proce
by infogulch 4y ago
So they're using Scylla to manually do what kafka does, basically processors polling for new records in a shard and updating their watermark once its done processing. I'm surprised that this is faster than just using kafka alone, though one of the reasons why they wanted to avoid kafka is dealing with deployment complexity and memory usage of kafka clusters.