> What are the use cases for adding yet another layer to the stack? in my limited experience with horovod, horovod is most useful when youre running large clus

> What are the use cases for adding yet another layer to the stack? in my limited experience with horovod, horovod is most useful when youre running large clusters of workers/ps. in those situations, you typically have to manually find the appropriate balance of workers/ps. (otherwise youd run into blocking or network saturation issues.) horovod addresses this issue with their ring allreduce implementation. having said all of that, im sticking with distributed tf for now.