3 ms·
One thing Kafka bite me is for each partition there can be only one consumer. If your consumer had performance issue (e.g using CPython) then you are out of luc
by est 6y ago
One thing Kafka bite me is for each partition there can be only one consumer. If your consumer had performance issue (e.g using CPython) then you are out of luck.
- bootlooped 6y agoThe thing this article pointed out to me, which I didn't know before, it that is why you should just set the partition count very high to begin with. Then you just horizontally scale consumers.
- est 6y agoYeas that's the lesson I learned the hard way. The publisher was from another department and had only 1 partition with large volume of data.