As @syllogism said, you can use any framework/library to train your models. A couple of libraries have a special integration, Tensorflow, MXNet, Horovod, and P

As @syllogism said, you can use any framework/library to train your models. A couple of libraries have a special integration, Tensorflow, MXNet, Horovod, and Pytorch, they have a section in the specification for users who want to run distributed experiments.