3 ms·
> You shouldn't need Kafka to handle a few hundred MB or a few GB of data per day. I wouldn't link the two problems (size, bad architecture). Kafka is often us
by Xorlev 8y ago
> You shouldn't need Kafka to handle a few hundred MB or a few GB of data per day.
I wouldn't link the two problems (size, bad architecture). Kafka is often used to bail out poorly designed data architectures, but it doesn't matter whether the volume is small or large at that point: it's still a pile of crap.
Even for smaller cases it's a nice way to decouple producers from multiple consumers. I wouldn't suggest building Kafka infrastructure if you don't also have at least one bigger use-case, but if it's there it's convenient. Especially if you need replay or the ability to consume the same messages for days afterwards.