3 ms·But for the training it does. You need to communicate gradient changes between GPUs.by pk-protect-ai 2y agoBut for the training it does. You need to communicate gradient changes between GPUs.