3 ms·
> Kafka couldn't cope up if there are hundreds or few thousands topics. High CPU load, longer startup times... It also uses num_partitions*2 open file descript
by helsinki 5y ago
> Kafka couldn't cope up if there are hundreds or few thousands topics. High CPU load, longer startup times...
It also uses num_partitions*2 open file descriptors per topic, which can quickly surpass the default ulimit on a host. Always remember to raise the ulimit before you near 1000 topics, otherwise Kafka crashes.