3 ms·
Kafka isn't particularly memory intensive. Confluent suggests a small (5gb) heap and to let the OS filesystem caching handle the rest [0]. It is still early d
by coredog64 10y ago
Kafka isn't particularly memory intensive. Confluent suggests a small (5gb) heap and to let the OS filesystem caching handle the rest [0]. It is still early days in my deployment, but I believe IOPs are going to be the bottleneck.
[0] http://docs.confluent.io/1.0/kafka/deployment.html http://docs.confluent.io/1.0/kafka/deployment.html
- Sphax 10y agoYeah same, the only problems we've had with our cluster has been disks, RAID 5 is a bad idea with Kafka. Other than that we've been running our cluster for almost 2 years now with the same 32GB servers, never once had a problem with memory or CPU, and we've been pushing more and more data into it.
- deleted 10y ago[deleted]
- geodel 10y agoIt is in general Java itself thats memory intensive compare to Go.