2 ms·
The fact that you think this is a proper way to deal with a queue is quite concerning. You completely missed the point. It's the producer that needs to be paus
by mgaunard 5y ago
The fact that you think this is a proper way to deal with a queue is quite concerning.
You completely missed the point. It's the producer that needs to be paused, and the reason for that is that memory is not infinite. You cannot just keep buffering until the consumer catches up, because it may never catch up.
- jeffbee 5y agoWhile it is true that Kafka does not guarantee long-term steady state behavior, it is modeled as an impedance adapter of infinite capacity. It presents no impedance to the producer, has storage that is much larger than the arrival rate, and drains to the consumer as available. Any feedback between the consumer and producer has to happen out of band, which is fine.
- mgaunard 5y agoAnd that is one of thr major defects I pointed out. It's not "fine".