I know these outages well ;). Running zk on its own (small) cluster helps a lot. I also nice the zk jvm all the way. Another tip for the desperate who find it

I know these outages well ;). Running zk on its own (small) cluster helps a lot. I also nice the zk jvm all the way. Another tip for the desperate who find it -- when solr cloud totally locks up you should look up who is acting as the OVERSEER in zookeeper and focus on restarting that node, possibly with others all down.