From the spec (8gb) it appears that NiFi was not needed. Were you co- locating zookeeper on the same nodes? Also you say it needed to be run periodically? It’

From the spec (8gb) it appears that NiFi was not needed. Were you co- locating zookeeper on the same nodes? Also you say it needed to be run periodically? It’s supposed to be a long running service. If you need something that you can spin up and shutdown in a container or VM then it is probably not the solution. Use it if you have high volumes of data you need to transport from A -> B. We run on a cluster with 256gb ram, 128 core per a node.