3 ms·
On the other hand Kafka partitions are relatively cheap on both broker and client side; 100 partitions does not require 100 parallel consumers so over-provision
by morelisp 6y ago
On the other hand Kafka partitions are relatively cheap on both broker and client side; 100 partitions does not require 100 parallel consumers so over-provisioning is not so risky.
- fuckadtech 6y agoYes, but this assumes that users have the foresight to over-provision (enough). It becomes an operational pain in reality. There is also no getting around the variation of the noisy (or slow) neighbor problem slowing down an entire partition. That also becomes an operational pain.