3 ms·
I don't think "while retaining ordering" is something you want to include here, since you can't guarantee processing order for any MQ system without serializing
by LgWoodenBadger 1y ago
I don't think "while retaining ordering" is something you want to include here, since you can't guarantee processing order for any MQ system without serializing the consumption down to a single consumer.
- rileymichael 1y agoabsolute order, you're correct. but several systems support demultiplexing an interleaved stream by some key so that order is retained for all messages in each key space (pulsar key_shared subscriptions, azure service bus sessions, etc). you're still serializing consumption / have an exclusive consumer for each key, but with global parallelism. here's the equivalent in parallel-consumer: https://github.com/confluentinc/parallel-consumer?tab=readme-ov-file#ordered-by-key https://github.com/confluentinc/parallel-consumer?tab=readme...