4 ms·
This post conflates 'big data' with what Kafka offers. Yes it can scale up, but what it gives you at any scale is a reliable ordered log that supports multiple
by karmakaze 6y ago
This post conflates 'big data' with what Kafka offers. Yes it can scale up, but what it gives you at any scale is a reliable ordered log that supports multiple producers and consumers. If this is not what you need, then by all means don't use it or similarly complex software. I've used AWS SQS and Kinesis at small and large (not big data) scales and even then in retrospect believe Kafka would have served much better.