3 ms·PyTorch Lightning 1.4 with TPU Pods, IPU Hardware, Fully Sharded Data-Parallel2 points by lnyan 5y ago