3 ms·
Does it train just as fast on gpus?
by jiggunjer 6y ago
Does it train just as fast on gpus?
- comicjk 6y agoIn my experience, not quite as fast for fully-tuned code, but the difference is small - and given the same project deadline, the PyTorch version will probably be faster.
- m0zg 6y agoProperly tuned (DistributedDataParallel + mixed precision) it will train faster, and consume a lot less RAM, allowing you to use larger batches, and higher LR.